Group items tagged

They also claim that OpenAI has used hardball tactics to prevent workers from voicing their concerns about the technology, including restrictive nondisparagement agreements that departing employees were asked to sign.

“OpenAI is really excited about building A.G.I., and they are recklessly racing to be the first there,” said Daniel Kokotajlo, a former researcher in OpenAI’s governance division and one of the group’s organizers.

Other members include William Saunders, a research engineer who left OpenAI in February, and three other former OpenAI employees: Carroll Wainwright, Jacob Hilton and Daniel Ziegler. Several current OpenAI employees endorsed the letter anonymously because they feared retaliation from the company,

At OpenAI, Mr. Kokotajlo saw that even though the company had safety protocols in place — including a joint effort with Microsoft known as the “deployment safety board,” which was supposed to review new models for major risks before they were publicly released — they rarely seemed to slow anything down.

So was the departure of Dr. Leike, who along with Dr. Sutskever had led OpenAI’s “superalignment” team, which focused on managing the risks of powerful A.I. models. In a series of public posts announcing his departure, Dr. Leike said he believed that “safety culture and processes have taken a back seat to shiny products.”

“When I signed up for OpenAI, I did not sign up for this attitude of ‘Let’s put things out into the world and see what happens and fix them afterward,’” Mr. Saunders said.

Mr. Kokotajlo, 31, joined OpenAI in 2022 as a governance researcher and was asked to forecast A.I. progress. He was not, to put it mildly, optimistic.In his previous job at an A.I. safety organization, he predicted that A.G.I. might arrive in 2050. But after seeing how quickly A.I. was improving, he shortened his timelines. Now he believes there is a 50 percent chance that A.G.I. will arrive by 2027 — in just three years.

He also believes that the probability that advanced A.I. will destroy or catastrophically harm humanity — a grim statistic often shortened to “p(doom)” in A.I. circles — is 70 percent.

Last month, two senior A.I. researchers — Ilya Sutskever and Jan Leike — left OpenAI under a cloud. Dr. Sutskever, who had been on OpenAI’s board and voted to fire Mr. Altman, had raised alarms about the potential risks of powerful A.I. systems. His departure was seen by some safety-minded employees as a setback.

Mr. Kokotajlo said, he became so worried that, last year, he told Mr. Altman that the company should “pivot to safety” and spend more time and resources guarding against A.I.’s risks rather than charging ahead to improve its models. He said that Mr. Altman had claimed to agree with him, but that nothing much changed.

In April, he quit. In an email to his team, he said he was leaving because he had “lost confidence that OpenAI will behave responsibly" as its systems approach human-level intelligence.

“The world isn’t ready, and we aren’t ready,” Mr. Kokotajlo wrote. “And I’m concerned we are rushing forward regardless and rationalizing our actions.”

On his way out, Mr. Kokotajlo refused to sign OpenAI’s standard paperwork for departing employees, which included a strict nondisparagement clause barring them from saying negative things about the company, or else risk having their vested equity taken away.

Many employees could lose out on millions of dollars if they refused to sign. Mr. Kokotajlo’s vested equity was worth roughly $1.7 million, he said, which amounted to the vast majority of his net worth, and he was prepared to forfeit all of it.

Mr. Altman said he was “genuinely embarrassed” not to have known about the agreements, and the company said it would remove nondisparagement clauses from its standard paperwork and release former employees from their agreements.)

In their open letter, Mr. Kokotajlo and the other former OpenAI employees call for an end to using nondisparagement and nondisclosure agreements at OpenAI and other A.I. companies.

“Broad confidentiality agreements block us from voicing our concerns, except to the very companies that may be failing to address these issues,”

They also call for A.I. companies to “support a culture of open criticism” and establish a reporting process for employees to anonymously raise safety-related concerns.

They have retained a pro bono lawyer, Lawrence Lessig, the prominent legal scholar and activist

Mr. Kokotajlo and his group are skeptical that self-regulation alone will be enough to prepare for a world with more powerful A.I. systems. So they are calling for lawmakers to regulate the industry, too.

“There needs to be some sort of democratically accountable, transparent governance structure in charge of this process," Mr. Kokotajlo said. “Instead of just a couple of different private companies racing with each other, and keeping it all secret.”

this latest effort provoked a response that was swift and scathing and revealed something new: the existence of a tightknit group of scholars who are clamoring for more empathetic political analyses of rural Americans.

“We contribute to the further denigration of expertise when we say, ‘This is what the experts say about these rubes and bumpkins,’” said Mr. Jacobs, a co-author of “The Rural Voter.” “Who’s going to trust the experts when that’s what the experts have to say about you?”

There is an obvious reason for academics’ neglect of the political urban-rural divide until recently: It barely existed.

It’s only since the late 1990s that there has been a marked gap between rural and urban voting patterns in presidential elections, and it has widened ever since. In 2016, Mr. Trump won 59 percent of rural voters. Four years later, that climbed to 65 percent, according to Pew. And in the 2022 midterms, Republicans won 69 percent of the rural vote.

Even if that shift does hint that “rural” may now be its own kind of identity, it’s a cohort that’s hard to define.

The Census Bureau classifies any community as rural if it isn’t within an urban area, meaning it is not part of a densely settled area with 5,000 or more people or 2,000 or more housing units. (In the 2020 census, 20 percent of Americans were classified as rural.)

Beyond these basic definitional problems, rural communities can be wildly different socially. “When you aggregate to the national level, you lose so much,”

“I get frustrated especially when people talk about rural America as white America. In some states, it’s Latino America. In the Deep South, it’s Black America.”

Traditionally, political scientists argued that measuring the effects of place was just a proxy for looking at other parts of identity, like race or education. And because many did not come from rural areas, growing up rural didn’t tend to strike academics as a salient part of political identity.

Maybe because so few people fashioned themselves as “rural political experts” until recently, the few high-profile explanations for the rise of rural Republicanism were widely embraced by the chattering classes.

Thomas Frank in his best-selling 2004 book, “What’s the Matter With Kansas?” Mr. Frank, a historian, argued that the Republican focus on social issues, like abortion and guns, persuaded rural voters to put aside their economic interests and vote on cultural values rather than for candidates who supported unions and corporate regulation.

a handful of academics were so frustrated with the book that it inspired them to pursue their own research.

Ms. Cramer came to a different understanding from Mr. Frank’s of why people voted the way they did: Rural Americans resented city dwellers. They believed that national and state governments had enriched urban areas at the expense of rural ones, taking note of all the road-building in Madison, for example, when they drove to sports games.

Their reaction was hostility toward the very idea of government, so they supported politicians who promised to keep it out of their lives; Ms. Cramer called this “the politics of resentment.”

Ms. Cramer’s 2016 book, “The Politics of Resentment,” quickly became an anchor in the growing field of rural political studies. At least half a dozen academics credit her with foundational thinking for their research.

“A lot of the focus has been on ‘What’s wrong with those people?’” she said. “But most people studying what’s going on with rural political behavior are people with empathy for people who live in rural places. They aren’t discounting them as ignorant or uninformed. There’s more of an attempt to understand the way they’re seeing the world.”

When Mr. Jacobs decided this year to convene a group of 15 scholars for a conference called Rethinking Rural, he was struck by the flurry of excitement that greeted the invitations. “It was like the first time they’d been asked to the dance,”

What rankled the experts who had read “White Rural Rage” was what they considered slapdash analysis. The authors build some arguments on polls with sample sizes as small as 167 rural people. The book is filled with critiques of rural Americans — their resistance to pluralism, their willingness to embrace conspiracies — that apply to many groups and that some scholars reject because they are not based on the long-term observation they say is needed to truly understand the political motives of any community.

Mr. Jacobs, with the political scientist Dan Shea, conducted surveys of 10,000 rural voters, from Gambell, Alaska, to Lubec, Maine. The pair were struck by a commonality: Rural residents tend to focus less on their own economic circumstances and more on their community’s prosperity.

Even individuals who are thriving are attuned to whether their community as a whole is being left behind by economic changes like automation or the decline of coal.

That sense of “shared fate,” as the scholars put it, arises in part because rich and poor tend to cross paths often,

“If you go down my street in Vassalboro, the nicest house on the street is right across from the least nice house on the street,” Mr. Jacobs said. “Their kids go to the same school because there’s only one school.”

Such interconnectedness means that pollsters sometimes miss how rural voters are really feeling, he added. “It’s not enough to simply ask: Are you doing better than you were last year?

As millions left rural areas seeking economic opportunity, an appreciation formed for the businesspeople who stayed and tried to create jobs. That led to an outsize influence by local business leaders in the political realm, driving support for anti-union laws and tax policies generous to businesses.

Broadly, rural Americans see free trade and the rise of new technologies as hurting their communities while helping cities prosper

So the resentment they felt toward urbanites didn’t come out of nowhere.

“Rage and resentment are not interchangeable terms,” he wrote in Politico. “Rage implies irrationality, anger that is unjustified and out of proportion. You can’t talk to someone who is enraged. Resentment is rational, a reaction based on some sort of negative experience.”

And while resentment, like rage, doesn’t easily dissolve, he suggests that trying to understand where it comes from could start to build a bridge over that ever-widening urban-rural divide.