Group items tagged

A few weeks back, in January, the largest-ever survey of AI researchers found that 16% of them believed their work would lead to the extinction of humankind.

“That’s a one-in-six chance of catastrophe,” says Alistair Stewart, a former British soldier turned master’s student. “That’s Russian-roulette odds.”

What would the others have us do? Stewart, the soldier turned grad student, wants a moratorium on the development of AIs until we understand them better – until those Russian-roulette-like odds improve. Yudkowsky would have us freeze everything today, this instant. “You could say that nobody’s allowed to train something more powerful than GPT-4,” he suggests. “Humanity could decide not to die and it would not be that hard.”

The new start-up is called Safe Superintelligence. It aims to produce superintelligence — a machine that is more intelligent than humans — in a safe way, according to the company spokeswoman Lulu Cheng Meservey.

Last year, Dr. Sutskever helped create what was called a Superalignment team inside OpenAI that aimed to ensure that future A.I. technologies would not do harm. Like others in the field, he had grown increasingly concerned that A.I. could become dangerous and perhaps even destroy humanity.

Jan Leike, who ran the Superalignment team alongside Dr. Sutskever, has also resigned from OpenAI. He has since been hired by OpenAI’s competitor Anthropic, another company founded by former OpenAI researchers.

According to the Public Religion Research Institute’s 2023 American Values Atlas, 55 percent of Trump supporters are Christian nationalists, as measured by their agreement with statements like “Being Christian is an important part of being truly American” and “God has called Christians to exercise dominion over all areas of American society.”

The Christian right increasingly sees American politics as zero-sum, meaning it is either going to triumph or face subjugation. As Justice Samuel Alito of the Supreme Court was recorded saying, “One side or the other is going to win.”

“When Hitler was in power, would it have made sense to say ‘he’s bad on this front but on the other hand, he’s built good roads and the trains run on time, so let’s be balanced’? In a normal situation, I would be more neutral, but this is not the time for neutrality. This election is a fight for Indian democracy. If we lose, there won’t be any chance in future to be neutral.”

His journey is poignant and essential as he moves from trying to become part of a story to realizing that stories are lies we tell to make sense of a reality that defies simple narrative.