Group items tagged

Again and again, the Facebook Papers show staffers sounding alarms about the dangers posed by the platform—how Facebook amplifies extremism and misinformation, how it incites violence, how it encourages radicalization and political polarization. Again and again, staffers reckon with the ways in which Facebook’s decisions stoke these harms, and they plead with leadership to do more.

And again and again, staffers say, Facebook’s leaders ignore them.

Facebook has dismissed the concerns of its employees in manifold ways.

One of its cleverer tactics is to argue that staffers who have raised the alarm about the damage done by their employer are simply enjoying Facebook’s “very open culture,” in which people are encouraged to share their opinions, a spokesperson told me. This stance allows Facebook to claim transparency while ignoring the substance of the complaints, and the implication of the complaints: that many of Facebook’s employees believe their company operates without a moral compass.

When you stitch together the stories that spanned the period between Joe Biden’s election and his inauguration, it’s easy to see Facebook as instrumental to the attack on January 6. (A spokesperson told me that the notion that Facebook played an instrumental role in the insurrection is “absurd.”)

what emerges from a close reading of Facebook documents, and observation of the manner in which the company connects large groups of people quickly, is that Facebook isn’t a passive tool but a catalyst. Had the organizers tried to plan the rally using other technologies of earlier eras, such as telephones, they would have had to identify and reach out individually to each prospective participant, then persuade them to travel to Washington. Facebook made people’s efforts at coordination highly visible on a global scale.

The platform not only helped them recruit participants but offered people a sense of strength in numbers. Facebook proved to be the perfect hype machine for the coup-inclined.

In November 2019, Facebook staffers noticed they had a serious problem. Facebook offers a collection of one-tap emoji reactions. Today, they include “like,” “love,” “care,” “haha,” “wow,” “sad,” and “angry.” Company researchers had found that the posts dominated by “angry” reactions were substantially more likely to go against community standards, including prohibitions on various types of misinformation, according to internal documents.

In July 2020, researchers presented the findings of a series of experiments. At the time, Facebook was already weighting the reactions other than “like” more heavily in its algorithm—meaning posts that got an “angry” reaction were more likely to show up in users’ News Feeds than posts that simply got a “like.” Anger-inducing content didn’t spread just because people were more likely to share things that made them angry; the algorithm gave anger-inducing content an edge. Facebook’s Integrity workers—employees tasked with tackling problems such as misinformation and espionage on the platform—concluded that they had good reason to believe targeting posts that induced anger would help stop the spread of harmful content.

By dialing anger’s weight back to zero in the algorithm, the researchers found, they could keep posts to which people reacted angrily from being viewed by as many users. That, in turn, translated to a significant (up to 5 percent) reduction in the hate speech, civic misinformation, bullying, and violent posts—all of which are correlated with offline violence—to which users were exposed.

Facebook rolled out the change in early September 2020, documents show; a Facebook spokesperson confirmed that the change has remained in effect. It was a real victory for employees of the Integrity team.

But it doesn’t normally work out that way. In April 2020, according to Frances Haugen’s filings with the SEC, Facebook employees had recommended tweaking the algorithm so that the News Feed would deprioritize the surfacing of content for people based on their Facebook friends’ behavior. The idea was that a person’s News Feed should be shaped more by people and groups that a person had chosen to follow. Up until that point, if your Facebook friend saw a conspiracy theory and reacted to it, Facebook’s algorithm might show it to you, too. The algorithm treated any engagement in your network as a signal that something was worth sharing. But now Facebook workers wanted to build circuit breakers to slow this form of sharing.

Experiments showed that this change would impede the distribution of hateful, polarizing, and violence-inciting content in people’s News Feeds. But Zuckerberg “rejected this intervention that could have reduced the risk of violence in the 2020 election,” Haugen’s SEC filing says. An internal message characterizing Zuckerberg’s reasoning says he wanted to avoid new features that would get in the way of “meaningful social interactions.” But according to Facebook’s definition, its employees say, engagement is considered “meaningful” even when it entails bullying, hate speech, and reshares of harmful content.

This episode, like Facebook’s response to the incitement that proliferated between the election and January 6, reflects a fundamental problem with the platform

Facebook’s megascale allows the company to influence the speech and thought patterns of billions of people. What the world is seeing now, through the window provided by reams of internal documents, is that Facebook catalogs and studies the harm it inflicts on people. And then it keeps harming people anyway.

“I am worried that Mark’s continuing pattern of answering a different question than the question that was asked is a symptom of some larger problem,” wrote one Facebook employee in an internal post in June 2020, referring to Zuckerberg. “I sincerely hope that I am wrong, and I’m still hopeful for progress. But I also fully understand my colleagues who have given up on this company, and I can’t blame them for leaving. Facebook is not neutral, and working here isn’t either.”

It is quite a thing to see, the sheer number of Facebook employees—people who presumably understand their company as well as or better than outside observers—who believe their employer to be morally bankrupt.

I spoke with several former Facebook employees who described the company’s metrics-driven culture as extreme, even by Silicon Valley standards

Facebook workers are under tremendous pressure to quantitatively demonstrate their individual contributions to the company’s growth goals, they told me. New products and features aren’t approved unless the staffers pitching them demonstrate how they will drive engagement.

e worries have been exacerbated lately by fears about a decline in new posts on Facebook, two former employees who left the company in recent years told me. People are posting new material less frequently to Facebook, and its users are on average older than those of other social platforms.

One of Facebook’s Integrity staffers wrote at length about this dynamic in a goodbye note to colleagues in August 2020, describing how risks to Facebook users “fester” because of the “asymmetrical” burden placed on employees to “demonstrate legitimacy and user value” before launching any harm-mitigation tactics—a burden not shared by those developing new features or algorithm changes with growth and engagement in mind

The note said:We were willing to act only after things had spiraled into a dire state … Personally, during the time that we hesitated, I’ve seen folks from my hometown go further and further down the rabbithole of QAnon and Covid anti-mask/anti-vax conspiracy on FB. It has been painful to observe.

Current and former Facebook employees describe the same fundamentally broken culture—one in which effective tactics for making Facebook safer are rolled back by leadership or never approved in the first place.

That broken culture has produced a broken platform: an algorithmic ecosystem in which users are pushed toward ever more extreme content, and where Facebook knowingly exposes its users to conspiracy theories, disinformation, and incitement to violence.

One example is a program that amounts to a whitelist for VIPs on Facebook, allowing some of the users most likely to spread misinformation to break Facebook’s rules without facing consequences. Under the program, internal documents show, millions of high-profile users—including politicians—are left alone by Facebook even when they incite violence

whitelisting influential users with massive followings on Facebook isn’t just a secret and uneven application of Facebook’s rules; it amounts to “protecting content that is especially likely to deceive, and hence to harm, people on our platforms.”

Facebook workers tried and failed to end the program. Only when its existence was reported in September by The Wall Street Journal did Facebook’s Oversight Board ask leadership for more information about the practice. Last week, the board publicly rebuked Facebook for not being “fully forthcoming” about the program.

As a result, Facebook has stoked an algorithm arms race within its ranks, pitting core product-and-engineering teams, such as the News Feed team, against their colleagues on Integrity teams, who are tasked with mitigating harm on the platform. These teams establish goals that are often in direct conflict with each other.

“We can’t pretend we don’t see information consumption patterns, and how deeply problematic they are for the longevity of democratic discourse,” a user-experience researcher wrote in an internal comment thread in 2019, in response to a now-infamous memo from Andrew “Boz” Bosworth, a longtime Facebook executive. “There is no neutral position at this stage, it would be powerfully immoral to commit to amorality.”

Zuckerberg has defined Facebook’s mission as making “social infrastructure to give people the power to build a global community that works for all of us,” but in internal research documents his employees point out that communities aren’t always good for society:

When part of a community, individuals typically act in a prosocial manner. They conform, they forge alliances, they cooperate, they organize, they display loyalty, they expect obedience, they share information, they influence others, and so on. Being in a group changes their behavior, their abilities, and, importantly, their capability to harm themselves or others

Thus, when people come together and form communities around harmful topics or identities, the potential for harm can be greater.

The infrastructure choices that Facebook is making to keep its platform relevant are driving down the quality of the site, and exposing its users to more dangers

hose dangers are also unevenly distributed, because of the manner in which certain subpopulations are algorithmically ushered toward like-minded groups

And the subpopulations of Facebook users who are most exposed to dangerous content are also most likely to be in groups where it won’t get reported.

And it knows that 3 percent of Facebook users in the United States are super-consumers of conspiracy theories, accounting for 37 percent of known consumption of misinformation on the platform.

Zuckerberg’s positioning of Facebook’s role in the insurrection is odd. He lumps his company in with traditional media organizations—something he’s ordinarily loath to do, lest the platform be expected to take more responsibility for the quality of the content that appears on it—and suggests that Facebook did more, and did better, than journalism outlets in its response to January 6. What he fails to say is that journalism outlets would never be in the position to help investigators this way, because insurrectionists don’t typically use newspapers and magazines to recruit people for coups.

Facebook wants people to believe that the public must choose between Facebook as it is, on the one hand, and free speech, on the other. This is a false choice. Facebook has a sophisticated understanding of measures it could take to make its platform safer without resorting to broad or ideologically driven censorship tactics.

Facebook knows that no two people see the same version of the platform, and that certain subpopulations experience far more dangerous versions than others do

Facebook knows that people who are isolated—recently widowed or divorced, say, or geographically distant from loved ones—are disproportionately at risk of being exposed to harmful content on the platform.

It knows that repeat offenders are disproportionately responsible for spreading misinformation.

All of this makes the platform rely more heavily on ways it can manipulate what its users see in order to reach its goals. This explains why Facebook is so dependent on the infrastructure of groups, as well as making reshares highly visible, to keep people hooked.

It could consistently enforce its policies regardless of a user’s political power.

Facebook could ban reshares.

It could choose to optimize its platform for safety and quality rather than for growth.

It could tweak its algorithm to prevent widespread distribution of harmful content.

Facebook could create a transparent dashboard so that all of its users can see what’s going viral in real time.

It could make public its rules for how frequently groups can post and how quickly they can grow.

It could also automatically throttle groups when they’re growing too fast, and cap the rate of virality for content that’s spreading too quickly.

Facebook could shift the burden of proof toward people and communities to demonstrate that they’re good actors—and treat reach as a privilege, not a right

You must be vigilant about the informational streams you swim in, deliberate about how you spend your precious attention, unforgiving of those who weaponize your emotions and cognition for their own profit, and deeply untrusting of any scenario in which you’re surrounded by a mob of people who agree with everything you’re saying.

It could do all of these things. But it doesn’t.

Lately, people have been debating just how nefarious Facebook really is. One argument goes something like this: Facebook’s algorithms aren’t magic, its ad targeting isn’t even that good, and most people aren’t that stupid.

All of this may be true, but that shouldn’t be reassuring. An algorithm may just be a big dumb means to an end, a clunky way of maneuvering a massive, dynamic network toward a desired outcome. But Facebook’s enormous size gives it tremendous, unstable power.

Facebook takes whole populations of people, pushes them toward radicalism, and then steers the radicalized toward one another.

When the most powerful company in the world possesses an instrument for manipulating billions of people—an instrument that only it can control, and that its own employees say is badly broken and dangerous—we should take notice.

The lesson for individuals is this:

Facebook could say that its platform is not for everyone. It could sound an alarm for those who wander into the most dangerous corners of Facebook, and those who encounter disproportionately high levels of harmful content

Without seeing how Facebook works at a finer resolution, in real time, we won’t be able to understand how to make the social web compatible with democracy.

The truth is that all of Silicon Valley, not just Facebook, is in desperate want of a big new idea.

We may always feel like we’re on our phones too much, that we’re already devoting a surfeit of time to our screens, but the truth is we have much more time to give our platforms. If we had screens over our eyes, we could be captive consumers of content and advertising quite literally all the time. Not only that, but if the metaverse went mainstream, it would necessitate a whole swath of new hardware and profit-generating apps too.

The industry needs this framework—at a moment of “unprecedented liquidity for VC funds,” as the investor Matt Cohen put it at Crunchbase, investors are dying for something like a metaverse to pour capital into.

Allowing this company—this industry—to rush headlong into building anything remotely metaverse-like would merely reproduce, if not exacerbate, the problems that arose when it hastily launched the social-media platforms that now define online life.

with Facebook desperately trying to change the terms of the game, Zuckerberg looking to assert himself as more than just the operator of a particularly toxic yearbook feed, and the conditions ripe for the industry to pour cash into the pieces necessary to build some metaverse-shaped thing, they may just wind up succeeding—and replicating outright the dystopian metaverse their source material has warned us about.

ucing snowfall in the northern Plains and the Upper Midwest, with heavy snow in parts of Minnesota and Iowa coming down at rates of one to two inches per hour

In a weekend forecast, NBC’s "TODAY" weather anchor Al Roker said the storm system could bring 6 to 12 inches of snow stretching from the Dakotas down to Missouri.

Snow is also expected to develop over parts of the central and southern Appalachians, with pockets of rain and freezing rain potentially developing over the Carolinas and the southern Appalachians overnight Saturday into Sunday morning.

Roker said the system was expected to move south before making its way up the Eastern coast into Sunday and Monday, bringing heavy wind and rain if it continues along its expected track. On Sunday, a wintry mix is expected to hit parts of the Southeast, including Atlanta, as a significant ice storm unfolds across the Carolinas.

that’s particularly true on the I.R.A., which has to build all these things in the real world.

we’re trying to do industrial physical transformation at a speed and scale unheralded in American history. This is bigger than anything we have done at this speed ever.

The money is beginning to move out the door now, but we’re on a clock. Climate change is not like some other issues where if you don’t solve it this year, it is exactly the same to solve it next year. This is an issue where every year you don’t solve it, the amount of greenhouse gases in the atmosphere builds, warming builds, the effects compound

Solve, frankly, isn’t the right word there because all we can do is abate, a lot of the problems now baked in. So how is it going, and who can actually walk us through that?

Robinson Meyer is the founding executive editor of heatmap.news

why do all these numbers differ so much? How big is this thing?

in electric vehicles and in the effort, kind of this dual effort in the law, to both encourage Americans to buy and use electric vehicles and then also to build a domestic manufacturing base for electric vehicles.

on both counts, the data’s really good on electric vehicles. And that’s where we’re getting the fastest response from industry and the clearest response from industry to the law.

ROBINSON MEYER: Factories are getting planned. Steel’s going in the ground. The financing for those factories is locked down. It seems like they’re definitely going to happen. They’re permitted. Companies are excited about them. Large Fortune 500 automakers are confidently and with certainty planning for an electric vehicle future, and they’re building the factories to do that in the United States. They’re also building the factories to do that not just in blue states. And so to some degree, we can see the political certainty for electric vehicles going forward.

in other parts of the law, partially due to just vagaries of how the law is being implemented, tax credits where the fine print hasn’t worked out yet, it’s too early to say whether the law is working and how it’s going and whether it’s going to accomplish its goal

EZRA KLEIN: I always find this very funny in a way. The Congressional Budget Office scored it. They thought it would make about $380 billion in climate investments over a decade. So then you have all these other analyses coming out.

But there’s actually this huge range of outcomes in between where the thing passes, and maybe what you wanted to have happen happens. Maybe it doesn’t. Implementation is where all this rubber meets the road

the Rhodium Group, which is a consulting firm, they think it could be as high as $522 billion, which is a big difference. Then there’s this Goldman Sachs estimate, which the administration loves, where they say they’re projecting $1.2 trillion in incentives —

ROBINSON MEYER: All the numbers differ because most of the important incentives, most of the important tax credits and subsidies in the I.R.A., are uncapped. There’s no limit to how much the government might spend on them. All that matters is that some private citizen or firm or organization come to the government and is like, hey, we did this. You said you’d give us money for it. Give us the money.

because of that, different banks have their own energy system models, their own models of the economy. Different research groups have their own models.

we know it’s going to be wrong because the Congressional Budget Office is actually quite constrained in how it can predict how these tax credits are taken up. And it’s constrained by the technology that’s out there in the country right now.

The C.B.O. can only look at the number of electrolyzers, kind of the existing hydrogen infrastructure in the country, and be like, well, they’re probably all going to use these tax credits. And so I think they said that there would be about $5 billion of take up for the hydrogen tax credits.

But sometimes money gets allocated, and then costs overrun, and there delays, and you can’t get the permits, and so on, and the thing never gets built

the fact that the estimates are going up is to them early evidence that this is going well. There is a lot of applications. People want the tax credits. They want to build these new factories, et cetera.

a huge fallacy that we make in policy all the time is assuming that once money is allocated for something, you get the thing you’re allocating the money for. Noah Smith, the economics writer, likes to call this checkism, that money equals stuff.

EZRA KLEIN: They do not want that, and not wanting that and putting every application through a level of scrutiny high enough to try and make sure you don’t have another one

I don’t think people think a lot about who is cutting these checks, but a lot of it is happening in this very obscure office of the Department of Energy, the Loan Program Office, which has gone from having $40 billion in lending authority, which is already a big boost over it not existing a couple decades ago, to $400 billion in loan authority,

the Loan Program Office as one of the best places we have data on how this is going right now and one of the offices that’s responded fastest to the I.R.A.

the Loan Program Office is basically the Department of Energy’s in-house bank, and it’s kind of the closest thing we have in the US to what exists in other countries, like Germany, which is a State development bank that funds projects that are eventually going to be profitable.

It has existed for some time. I mean, at first, it kind of was first to play after the Recovery Act of 2009. And in fact, early in its life, it gave a very important loan to Tesla. It gave this almost bridge loan to Tesla that helped Tesla build up manufacturing capacity, and it got Tesla to where it is today.

EZRA KLEIN: It’s because one of the questions I have about that office and that you see in some of the coverage of them is they’re very afraid of having another Solyndra.

Now, depending on other numbers, including the D.O.E., it’s potentially as high as $100 billion, but that’s because the whole thing about the I.R.A. is it’s meant to encourage the build-out of this hydrogen infrastructure.

EZRA KLEIN: I’m never that excited when I see a government loans program turning a profit because I think that tends to mean they’re not making risky enough loans. The point of the government should be to bear quite a bit of risk —

And to some degree, Ford now has to compete, and US automakers are trying to catch up with Chinese EV automakers. And its firms have EV battery technology especially, but just have kind of comprehensive understanding of the EV supply chain that no other countries’ companies have

ROBINSON MEYER: You’re absolutely right that this is the key question. They gave this $9.2 billion loan to Ford to build these EV battery plants in Kentucky and Tennessee. It’s the largest loan in the office’s history. It actually means that the investment in these factories is going to be entirely covered by the government, which is great for Ford and great for our build-out of EVs

And to some degree, I should say, one of the roles of L.P.O. and one of the roles of any kind of State development bank, right, is to loan to these big factory projects that, yes, may eventually be profitable, may, in fact, assuredly be profitable, but just aren’t there yet or need financing that the private market can’t provide. That being said, they have moved very slowly, I think.

And they feel like they’re moving quickly. They just got out new guidelines that are supposed to streamline a lot of this. Their core programs, they just redefined and streamlined in the name of speeding them up

However, so far, L.P.O. has been quite slow in getting out new loans

I want to say that the pressure they’re under is very real. Solyndra was a disaster for the Department of Energy. Whether that was fair or not fair, there’s a real fear that if you make a couple bad loans that go bad in a big way, you will destroy the political support for this program, and the money will be clawed back, a future Republican administration will wreck the office, whatever it might be. So this is not an easy call.

when you tell me they just made the biggest loan in their history to Ford, I’m not saying you shouldn’t lend any money to Ford, but when I think of what is the kind of company that cannot raise money on the capital markets, the one that comes to mind is not Ford

They have made loans to a number of more risky companies than Ford, but in addition to speed, do you think they are taking bets on the kinds of companies that need bets? It’s a little bit hard for me to believe that it would have been impossible for Ford to figure out how to finance factorie

ROBINSON MEYER: Now, I guess what I would say about that is that Ford is — let’s go back to why Solyndra failed, right? Solyndra failed because Chinese solar deluged the market. Now, why did Chinese solar deluge the market? Because there’s such support of Chinese financing from the state for massive solar factories and massive scale.

EZRA KLEIN: — the private market can’t. So that’s the meta question I’m asking here. In your view, because you’re tracking this much closer than I am, are they too much under the shadow of Solyndra? Are they being too cautious? Are they getting money out fast enough?

ROBINSON MEYER: I think that’s right; that basically, if we think the US should stay competitive and stay as close as it can and not even stay competitive, but catch up with Chinese companies, it is going to require large-scale state support of manufacturing.

EZRA KLEIN: OK, that’s fair. I will say, in general, there’s a constant thing you find reporting on government that people in government feel like they are moving very quickly

EZRA KLEIN: — given the procedural work they have to go through. And they often are moving very quickly compared to what has been done in that respect before, compared to what they have to get over. They are working weekends, they are working nights, and they are still not actually moving that quickly compared to what a VC firm can do or an investment bank or someone else who doesn’t have the weight of congressional oversight committees potentially calling you in and government procurement rules and all the rest of it.

ROBINSON MEYER: I think that’s a theme across the government’s implementation of the I.R.A. right now, is that generally the government feels like it’s moving as fast as it can. And if you look at the Department of Treasury, they feel like we are publishing — basically, the way that most of the I.R.A. subsidies work is that they will eventually be administered by the I.R.S., but first the Department of the Treasury has to write the guidebook for all these subsidies, right?

the law says there’s a very general kind of “here’s thousands of dollars for EVs under this circumstance.” Someone still has to go in and write all the fine print. The Department of Treasury is doing that right now for each tax credit, and they have to do that before anyone can claim that tax credit to the I.R.S. Treasury feels like it’s moving extremely quickly. It basically feels like it’s completely at capacity with these, and it’s sequenced these so it feels like it’s getting out the most important tax credits first.

Private industry feels like we need certainty. It’s almost a year since the law passed, and you haven’t gotten us the domestic content bonus. You haven’t gotten us the community solar bonus. You haven’t gotten us all these things yet.

a theme across the government right now is that the I.R.A. passed. Agencies have to write the regulations for all these tax credits. They feel like they’re moving very quickly, and yet companies feel like they’re not moving fast enough.

that’s how we get to this point where we’re 311 days out from the I.R.A. passing, and you’re like, well, has it made a big difference? And I’m like, well, frankly, wind and solar developers broadly don’t feel like they have the full understanding of all the subsidies they need yet to begin making the massive investments

I think it’s fair to say maybe the biggest bet on that is green hydrogen, if you’re looking in the bill.

We think it’s going to be an important tool in industry. It may be an important tool for storing energy in the power grid. It may be an important tool for anything that needs combustion.

ROBINSON MEYER: Yeah, absolutely. So green hydrogen — and let’s just actually talk about hydrogen broadly as this potential tool in the decarbonization tool kit.

It’s a molecule. It is a very light element, and you can burn it, but it’s not a fossil fuel. And a lot of the importance of hydrogen kind of comes back to that attribute of it.

So when we look at sectors of the economy that are going to be quite hard to decarbonize — and that’s because there is something about fossil fuels chemically that is essential to how that sector works either because they provide combustion heat and steelmaking or because fossil fuels are actually a chemical feedstock where the molecules in the fossil fuel are going into the product or because fossil fuels are so energy dense that you can carry a lot of energy while actually not carrying that much mass — any of those places, that’s where we look at hydrogen as going.

green hydrogen is something new, and the size of the bet is huge. So can you talk about first just what is green hydrogen? Because my understanding of it is spotty.

The I.R.A. is extremely generous — like extremely, extremely generous — in its hydrogen subsidies

The first is for what’s called blue hydrogen, which is hydrogen made from natural gas, where we then capture the carbon dioxide that was released from that process and pump it back into the ground. That’s one thing that’s subsidized. It’s basically subsidized as part of this broader set of packages targeted at carbon capture

green hydrogen, which is where we take water, use electrolyzers on it, basically zap it apart, take the hydrogen from the water, and then use that as a fue

The I.R.A. subsidies for green hydrogen specifically, which is the one with water and electricity, are so generous that relatively immediately, it’s going to have a negative cost to make green hydrogen. It will cost less than $0 to make green hydrogen. The government’s going to fully cover the cost of producing it.

That is intentional because what needs to happen now is that green hydrogen moves into places where we’re using natural gas, other places in the industrial economy, and it needs to be price competitive with those things, with natural gas, for instance. And so as it kind of is transported, it’s going to cost money

As you make the investment to replace the technology, it’s going to cost money. And so as the hydrogen moves through the system, it’s going to wind up being price competitive with natural gas, but the subsidies in the bill are so generous that hydrogen will cost less than $0 to make a kilogram of it

There seems to be a sense that hydrogen, green hydrogen, is something we sort of know how to make, but we don’t know how to make it cost competitive yet. We don’t know how to infuse it into all the processes that we need to be infused into. And so a place where the I.R.A. is trying to create a reality that does not yet exist is a reality where green hydrogen is widely used, we have to know how to use it, et cetera.

And they just seem to think we don’t. And so you need all these factories. You need all this innovation. Like, they have to create a whole innovation and supply chain almost from scratch. Is that right?

ROBINSON MEYER: That’s exactly right. There’s a great Department of Energy report that I would actually recommend anyone interested in this read called “The Liftoff Report for Clean Hydrogen.” They made it for a few other technologies. It’s a hundred-page book that’s basically how the D.O.E. believes we’re going to build out a clean hydrogen economy.

And, of course, that is policy in its own right because the D.O.E. is saying, here is the years we’re going to invest to have certain infrastructure come online. Here’s what we think we need. That’s kind of a signal to industry that everyone should plan around those years as well.

It’s a great book. It’s like the best piece of industrial policy I’ve actually seen from the government at all. But one of the points it makes is that you’re going to make green hydrogen. You’re then going to need to move it. You’re going to need to move it in a pipeline or maybe a truck or maybe in storage tanks that you then cart around.

Once it gets to a facility that uses green hydrogen, you’re going to need to store some green hydrogen there in storage tanks on site because you basically need kind of a backup supply in case your main supply fails. All of those things are going to add cost to hydrogen. And not only are they going to add cost, we don’t really know how to do them. We have very few pipelines that are hydrogen ready.

All of that investment needs to happen as a result to make the green hydrogen economy come alive. And why it’s so lavishly subsidized is to kind of fund all that downstream investment that’s eventually going to make the economy come true.

But a lot of what has to happen here, including once the money is given out, is that things we do know how to build get built, and they get built really fast, and they get built at this crazy scale.

So I’ve been reading this paper on what they call “The Greens’ Dilemma” by J.B. Ruhl and James Salzman, who also wrote this paper called “Old Green Laws, New Green Deal,” or something like that. And I think they get at the scale problem here really well.

“The largest solar facility currently online in the US is capable of generating 585 megawatts. To meet even a middle-road renewable energy scenario would require bringing online two new 400-megawatt solar power facilities, each taking up at least 2,000 acres of land every week for the next 30 years.”

And that’s just solar. We’re not talking wind there. We’re not talking any of the other stuff we’ve discussed here, transmission lines. Can we do that? Do we have that capacity?

ROBINSON MEYER: No, we do not. We absolutely do not. I think we’re going to build a ton of wind and solar. We do not right now have the system set up to use that much land to build that much new solar and wind by the time that we need to build it. I think it is partially because of permitting laws, and I think it’s also partially because right now there is no master plan

There’s no overarching strategic entity in the government that’s saying, how do we get from all these subsidies in the I.R.A. to net zero? What is our actual plan to get from where we are right now to where we’re emitting zero carbon as an economy? And without that function, no project is essential. No activity that we do absolutely needs to happen, and so therefore everything just kind of proceeds along at a convenient pace.

given the scale of what’s being attempted here, you might think that something the I.R.A. does is to have some entity in the government, as you’re saying, say, OK, we need this many solar farms. This is where we think we should put them. Let’s find some people to build them, or let’s build them ourselves.

what it actually does is there’s an office somewhere waiting for private companies to send in an application for a tax credit for solar that they say they’re going to build, and then we hope they build it

it’s an almost entirely passive process on the part of the government. Entirely would be going too far because I do think they talk to people, and they’re having conversations

the builder applies, not the government plans. Is that accurate?

ROBINSON MEYER: That’s correct. Yes.

ROBINSON MEYER: I think here’s what I would say, and this gets back to what do we want the I.R.A. to do and what are our expectations for the I.R.A

If the I.R.A. exists to build out a ton of green capacity and shift the political economy of the country toward being less dominated by fossil fuels and more dominated by the clean energy industry, frankly, then it is working

If the I.R.A. is meant to get us all the way to net zero, then it is not capable of that.

in 2022, right, we had no way to see how we were going to reduce emissions. We did not know if we were going to get a climate bill at all. Now, we have this really aggressive climate bill, and we’re like, oh, is this going to get us to net zero?

But getting to net zero was not even a possibility in 2022.

The issue is that the I.R.A. requires, ultimately, private actors to come forward and do these things. And as more and more renewables get onto the grid, almost mechanically, there’s going to be less interest in bringing the final pieces of decarbonized electricity infrastructure onto the grid as well.

EZRA KLEIN: Because the first things that get applied for are the ones that are more obviously profitable

The issue is when you talk to solar developers, they don’t see it like, “Am I going to make a ton of money, yes or no?” They see it like they have a capital stack, and they have certain incentives and certain ways to make money based off certain things they can do. And as more and more solar gets on the grid, building solar at all becomes less profitable

also, just generally, there’s less people willing to buy the solar.

as we get closer to a zero-carbon grid, there is this risk that basically less and less gets built because it will become less and less profitable

EZRA KLEIN: Let’s call that the last 20 percent risk

EZRA KLEIN: — or the last 40 percent. I mean, you can probably attach different numbers to that

ROBINSON MEYER: Permitting is the primary thing that is going to hold back any construction basically, especially out West,

right now permitting fights, the process under the National Environmental Policy Act just at the federal level, can take 4.5 years

let’s say every single project we need to do was applied for today, which is not true — those projects have not yet been applied for — they would be approved under the current permitting schedule in 2027.

ROBINSON MEYER: That’s before they get built.

Basically nobody on the left talked about permitting five years ago. I don’t want to say literally nobody, but you weren’t hearing it, including in the climate discussion.

people have moved to saying we do not have the laws, right, the permitting laws, the procurement laws to do this at the speed we’re promising, and we need to fix that. And then what you’re seeing them propose is kind of tweak oriented,

Permitting reform could mean a lot of different things, and Democrats and Republicans have different ideas about what it could mean. Environmental groups, within themselves, have different ideas about what it could mean.

for many environmental groups, the permitting process is their main tool. It is how they do the good that they see themselves doing in the world. They use the permitting process to slow down fossil fuel projects, to slow down projects that they see as harming local communities or the local environment.

ROBINSON MEYER: So we talk about the National Environmental Policy Act or NEPA. Let’s just start calling it NEPA. We talk about the NEPA process

NEPA requires the government basically study any environmental impact from a project or from a decision or from a big rule that could occur.

Any giant project in the United States goes through this NEPA process. The federal government studies what the environmental impact of the project will be. Then it makes a decision about whether to approve the project. That decision has nothing to do with the study. Now, notionally, the study is supposed to inform the project.

the decision the federal government makes, the actual “can you build this, yes or no,” legally has no connection to the study. But it must conduct the study in order to make that decision.

that permitting reform is so tough for the Democratic coalition specifically is that this process of forcing the government to amend its studies of the environmental impact of various decisions is the main tool that environmental litigation groups like Earthjustice use to slow down fossil fuel projects and use to slow down large-scale chemical or industrial projects that they don’t think should happen.

when we talk about making this program faster, and when we talk about making it more immune to litigation, they see it as we’re going to take away their main tools to fight fossil fuel infrastructure

why there’s this gap between rhetoric and what’s actually being proposed is that the same tool that is slowing down the green build-out is also what’s slowing down the fossil fuel build-out

ROBINSON MEYER: They’re the classic conflict here between the environmental movement classic, let’s call it, which was “think globally, act locally,” which said “we’re going to do everything we can to preserve the local environment,” and what the environmental movement and the climate movement, let’s say, needs to do today, which is think globally, act with an eye to what we need globally as well, which is, in some cases, maybe welcome projects that may slightly reduce local environmental quality or may seem to reduce local environmental quality in the name of a decarbonized world.

Because if we fill the atmosphere with carbon, nobody’s going to get a good environment.

Michael Gerrard, who is professor at Columbia Law School. He’s a founder of the Sabin Center for Climate Change Law there. It’s called “A Time for Triage,” and he has this sort of interesting argument that the environmental movement in general, in his view, is engaged in something he calls trade-off denial.

his view and the view of some people is that, look, the climate crisis is so bad that we just have to make those choices. We have to do things we would not have wanted to do to preserve something like the climate in which not just human civilization, but this sort of animal ecosystem, has emerged. But that’s hard, and who gets to decide which trade-offs to make?

what you’re not really seeing — not really, I would say, from the administration, even though they have some principles now; not really from California, though Gavin Newsom has a set of early things — is “this is what we think we need to make the I.R.A. happen on time, and this is how we’re going to decide what is a kind of project that gets this speedway through,” w

there’s a failure on the part of, let’s say, the environmental coalition writ large to have the courage to have this conversation and to sit down at a table and be like, “OK, we know that certain projects aren’t happening fast enough. We know that we need to build out faster. What could we actually do to the laws to be able to construct things faster and to meet our net-zero targets and to let the I.R.A. kind achieve what it could achieve?”

part of the issue is that we’re in this environment where Democrats control the Senate, Republicans control the House, and it feels very unlikely that you could just get “we are going to accelerate projects, but only those that are good for climate change,” into the law given that Republicans control the House.

part of the progressive fear here is that the right solutions must recognize climate change. Progressives are very skeptical that there are reforms that are neutral on the existence of climate change and whether we need to build faster to meet those demands that can pass through a Republican-controlled House.

one of the implications of that piece was it was maybe a huge mistake for progressives not to have figured out what they wanted here and could accept here, back when the negotiating partner was Joe Manchin.

Manchin’s bill is basically a set of moderate NEPA reforms and transmission reforms. Democrats, progressives refuse to move on it. Now, I do want to be fair here because I think Democrats absolutely should have seized on that opportunity, because it was the only moment when — we could tell already that Democrats — I mean, Democrats actually, by that moment, had lost the House.

I do want to be fair here that Manchin’s own account of what happened with this bill is that Senate Republicans killed it and that once McConnell failed to negotiate on the bill in December, Manchin’s bill was dead.

EZRA KLEIN: It died in both places.ROBINSON MEYER: It died in both places. I think that’s right.

Republicans already knew they were going to get the House, too, so they had less incentive to play along. Probably the time for this was October.

EZRA KLEIN: But it wasn’t like Democrats were trying to get this one done.

EZRA KLEIN: To your point about this was all coming down to the wire, Manchin could have let the I.R.A. pass many months before this, and they would have had more time to negotiate together, right? The fact that it was associated with Manchin in the way it was was also what made it toxic to progressives, who didn’t want to be held up by him anymore.

What becomes clear by the winter of this year, February, March of this year, is that as Democrats and Republicans begin to talk through this debt-ceiling process where, again, permitting was not the main focus. It was the federal budget. It was an entirely separate political process, basically.

EZRA KLEIN: I would say the core weirdness of the debt-ceiling fight was there was no main focus to it.

EZRA KLEIN: It wasn’t like past ones where it was about the debt. Republicans did some stuff to cut spending. They also wanted to cut spending on the I.R.S., which would increase the debt, right? It was a total mishmash of stuff happening in there.

That alchemy goes into the final debt-ceiling negotiations, which are between principals in Congress and the White House, and what we get is a set of basically the NEPA reforms in Joe Manchin’s bill from last year and the Mountain Valley pipeline, the thing that environmentalists were focused on blocking, and effectively no transmission reforms.

the set of NEPA reforms that were just enacted, that are now in the law, include — basically, the word reasonable has been inserted many times into NEPA. [LAUGHS] So the law, instead of saying the government has to study all environmental impacts, now it has to study reasonable environmental impacts.

this is a kind of climate win — has to study the environmental impacts that could result from not doing a project. The kind of average NEPA environmental impact study today is 500 pages and takes 4.5 years to produce. Under the law now, the government is supposed to hit a page limit of 150 to 300 pages.

there’s a study that’s very well cited by progressives from three professors in Utah who basically say, well, when you look at the National Forest Service, and you look at this 40,000 NEPA decisions, what mostly holds up these NEPA decisions is not like, oh, there’s too many requirements or they had to study too many things that don’t matter. It’s just there wasn’t enough staff and that staffing is primarily the big impediment. And so on the one hand, I think that’s probably accurate in that these are, in some cases — the beast has been starved, and these are very poorly staffed departments

The main progressive demand was just “we must staff it better.”

But if it’s taking you this much staffing and that much time to say something doesn’t apply to you, maybe you have a process problem —ROBINSON MEYER: Yes.EZRA KLEIN: — and you shouldn’t just throw endless resources at a broken process, which brings me — because, again, you can fall into this and never get out — I think, to the bigger critique her

these bills are almost symbolic because there’s so much else happening, and it’s really the way all this interlocks and the number of possible choke points, that if you touch one of them or even you streamline one of them, it doesn’t necessarily get you that f

“All told, over 60 federal permitting programs operate in the infrastructure approval regime, and that is just the federal system. State and local approvals and impact assessments could also apply to any project.”

their view is that under this system, it’s simply not possible to build the amount of decarbonization infrastructure we need at the pace we need it; that no amount of streamlining NEPA or streamlining, in California, CEQA will get you there; that we basically have been operating under what they call an environmental grand bargain dating back to the ’70s, where we built all of these processes to slow things down and to clean up the air and clean up the water.

we accepted this trade-off of slower building, quite a bit slower building, for a cleaner environment. And that was a good trade. It was addressing the problems of that era

now we have the problems of this era, which is we need to unbelievably, rapidly build out decarbonization infrastructure to keep the climate from warming more than we can handle and that we just don’t have a legal regime or anything.

You would need to do a whole new grand bargain for this era. And I’ve not seen that many people say that, but it seems true to me

the role that America had played in the global economy in the ’50s and ’60s where we had a ton of manufacturing, where we were kind of the factory to a world rebuilding from World War II, was no longer tenable and that, also, we wanted to focus on more of these kind of high-wage, what we would now call knowledge economy jobs.That was a large economic transition happening in the ’70s and ’80s, and it dovetailed really nicely with the environmental grand bargain.

At some point, the I.R.A. recognizes that that environmental grand bargain is no longer operative, right, because it says, we’re going to build all this big fiscal fixed infrastructure in the United States, we’re going to become a manufacturing giant again, but there has not been a recognition among either party of what exactly that will mean and what will be required to have it take hold.

It must require a form of on-the-ground, inside-the-fenceline, “at the site of the power plant” pollution control technology. The only way to do that, really, is by requiring carbon capture and requiring the large construction of major industrial infrastructure at many, many coal plants and natural gas plants around the country in order to capture carbon so it doesn’t enter the atmosphere, and so we don’t contribute to climate change. That is what the Supreme Court has ruled. Until that body changes, that is going to be the law.

So the E.P.A. has now, last month, proposed a new rule under the Clean Air Act that is going to require coal plants and some natural gas plants to install carbon capture technology to do basically what the Supreme Court has all but kind of required the E.P.A. to do

the E.P.A. has to demonstrate, in order to kind of make this rule the law and in order to make this rule pass muster with the Supreme Court, that this is tenable, that this is the best available and technologically feasible option

that means you actually have to allow carbon capture facilities to get built and you have to create a legal process that will allow carbon capture facilities to get built. And that means you need to be able to tell a power plant operator that if they capture carbon, there’s a way they can inject it back into the ground, the thing that they’re supposed to do with it.

Well, E.P.A. simultaneously has only approved the kind of well that you need to inject carbon that you’ve captured from a coal factory or a natural gas line back into the ground. It’s called a Class 6 well. The E.P.A. has only ever approved two Class 6 wells. It takes years for the E.P.A. to approve a Class 6 well.

And environmental justice groups really, really oppose these Class 6 wells because they see any carbon capture as an effort to extend the life of the fossil fuel infrastructure

The issue here is that it seems like C.C.S., carbon capture, is going to be essential to how the U.S. decarbonizes. Legally, we have no other choice because of the constraints the Supreme Court has placed on the E.P.A.. At the same time, environmental justice groups, and big green groups to some extent, oppose building out any C.C.S.

to be fair to them, right, they would say there are other ways to decarbonize. That may not be the way we’ve chosen because the politics weren’t there for it, but there are a lot of these groups that believe you could have 100 percent renewables, do not use all that much carbon capture, right? They would have liked to see a different decarbonization path taken too. I’m not sure that path is realistic.

what you do see are environmental groups opposing making it possible to build C.C.S. anywhere in the country at all.

EZRA KLEIN: The only point I’m making here is I think this is where you see a compromise a lot of them didn’t want to make —ROBINSON MEYER: Exactly, yeah.EZRA KLEIN: — which is a decarbonization strategy that actually does extend the life cycle of a lot of fossil fuel infrastructure using carbon capture. And because they never bought onto it, they’re still using the pathway they have to try to block it. The problem is that’s part of the path that’s now been chosen. So if you block it, you just don’t decarbonize. It’s not like you get the 100 percent renewable strategy.

ROBINSON MEYER: Exactly. The bargain that will emerge from that set of actions and that set of coalitional trade-offs is we will simply keep running this, and we will not cap it.

What could be possible is that progressives and Democrats and the E.P.A. turns around and says, “Oh, that’s fine. You can do C.C.S. You just have to cap every single stationary source in the country.” Like, “You want to do C.C.S.? We totally agree. Essential. You must put CSS infrastructure on every power plant, on every factory that burns fossil fuels, on everything.”

If progressives were to do that and were to get it into the law — and there’s nothing the Supreme Court has said, by the way, that would limit progressives from doing that — the upshot would be we shut down a ton more stationary sources and a ton more petrochemical refineries and these bad facilities that groups don’t want than we would under the current plan.

what is effectively going to happen is that way more factories and power plants stay open and uncapped than would be otherwise.

EZRA KLEIN: So Republican-controlled states are just on track to get a lot more of it. So the Rocky Mountain Institute estimates that red states will get $623 billion in investments by 2030 compared to $354 billion for blue states.

why are red states getting so much more of this money?

ROBINSON MEYER: I think there’s two reasons. I think, first of all, red states have been more enthusiastic about getting the money. They’re the ones giving away the tax credits. They have a business-friendly environment. And ultimately, the way many, many of these red-state governors see it is that these are just businesses.

I think the other thing is that these states, many of them, are right-to-work states. And so they might pay their workers less. They certainly face much less risk financially from a unionization campaign in their state.

regardless of the I.R.A., that’s where manufacturing and industrial investment goes in the first place. And that’s where it’s been going for 20 years because of the set of business-friendly and local subsidies and right-to-work policies.

I think the administration would say, we want this to be a big union-led effort. We want it to go to the Great Lakes states that are our political firewall.

and it would go to red states, because that’s where private industry has been locating since the ’70s and ’80s, and it would go to the Southeast, right, and the Sunbelt, and that that wouldn’t be so bad because then you would get a dynamic where red-state senators, red-state representatives, red-state governors would want to support the transition further and would certainly not support the repeal of the I.R.A. provisions and the repeal of climate provisions, and that you’d get this kind of nice vortex of the investment goes to red states, red states feel less antagonistic toward climate policies, more investment goes to red states. Red-state governors might even begin to support environmental regulation because that basically locks in benefits and advantages to the companies located in their states already.

I think what you see is that Republicans are increasingly warming to EV investment, and it’s actually building out renewables and actually building out clean electricity generation, where you see them fighting harder.

The other way that permitting matters — and this gets into the broader reason why private investment was generally going to red states and generally going to the Sunbelt — is that the Sunbelt states — Georgia, Texas — it’s easier to be there as a company because housing costs are lower and because the cost of living is lower in those states.

it’s also partially because the Sunbelt and the Southeast, it was like the last part of the country to develop, frankly, and there’s just a ton more land around all the cities, and so you can get away with the sprawling suburban growth model in those citie

It’s just cheaper to keep building suburbs there.

EZRA KLEIN: So how are you seeing the fights over these rare-earth metals and the effort to build a safe and, if not domestic, kind of friend-shored supply chain there?

Are we going to be able to source some of these minerals from the U.S.? That process seems to be proceeding but going slowly. There are some minerals we’re not going to be able to get from the United States at all and are going to have to get from our allies and partners across the world.

The kind of open question there is what exactly is the bargain we’re going to strike with countries that have these critical minerals, and will it be fair to those countries?

it isn’t to say that I think the I.R.A. on net is going to be bad for other countries. I just think we haven’t really figured out what deal and even what mechanisms we can use across the government to strike deals with other countries to mine the minerals in those countries while being fair and just and creating the kind of economic arrangement that those countries want.

, let’s say we get the minerals. Let’s say we learn how to refine them. There is many parts of the battery and many parts of EVs and many, many subcomponents in these green systems that there’s not as strong incentive to produce in the U.S.

at the same time, there’s a ton of technology. One answer to that might be to say, OK, well, what the federal government should do is just make it illegal for any of these battery makers or any of these EV companies to work with Chinese companies, so then we’ll definitely establish this parallel supply chain. We’ll learn how to make cathodes and anodes. We’ll figure it out

The issue is that there’s technology on the frontier that only Chinese companies have, and U.S. automakers need to work with those companies in order to be able to compete with them eventually.

EZRA KLEIN: How much easier would it be to achieve the I.R.A.’s goals if America’s relationship with China was more like its relationship with Germany?

ROBINSON MEYER: It would be significantly easier, and I think we’d view this entire challenge very differently, because China, as you said, not only is a leader in renewable energy. It actually made a lot of the important technological gains over the past 15 years to reducing the cost of solar and wind. It really did play a huge role on the supply side of reducing the cost of these technologies.

If we could approach that, if China were like Germany, if China were like Japan, and we could say, “Oh, this is great. China’s just going to make all these things. Our friend, China, is just going to make all these technologies, and we’re going to import them.

So it refines 75 percent of the polysilicon that you need for solar, but the machines that do the refining, 99 percent of them are made in China. I think it would be reckless for the U.S. to kind of rely on a single country and for the world to rely on a single country to produce the technologies that we need for decarbonization and unwise, regardless of our relationship with that country.

We want to geographically diversify the supply chain more, but it would be significantly easier if we did not have to also factor into this the possibility that the US is going to need to have an entirely separate supply chain to make use of for EVs, solar panels, wind turbines, batteries potentially in the near-term future.

, what are three other books they should read?

The first book is called “The End of the World” by Peter Brannen. It’s a book that’s a history of mass extinctions, the Earth’s five mass extinctions, and, actually, why he doesn’t think we’re currently in a mass extinction or why, at least, things would need to go just as bad as they are right now for thousands and thousands of years for us to be in basically the sixth extinction.

The book’s amazing for two reasons. The first is that it is the first that really got me to understand deep time.

he explains how one kind of triggered the next one. It is also an amazing book for understanding the centrality of carbon to Earth’s geological history going as far back as, basically, we can track.

“Climate Shock” by Gernot Wagner and Marty Weitzman. It’s about the economics of climate change

Marty Weitzman, who I think, until recently, was kind of the also-ran important economist of climate change. Nordhaus was the famous economist. He was the one who got all attention. He’s the one who won the Nobel.

He focuses on risk and that climate change is specifically bad because it will damage the environment, because it will make our lives worse, but it’s really specifically bad because we don’t know how bad it will be

it imposes all these huge, high end-tail risks and that blocking those tail risks is actually the main thing we want to do with climate policy.

That is I think, in some ways, what has become the U.S. approach to climate change and, to some degree, to the underlying economic thinking that drives even the I.R.A., where we want to just cut off these high-end mega warming scenarios. And this is a fantastic explanation of that particular way of thinking and of how to apply that way of thinking to climate change and also to geoengineerin

The third book, a little controversial, is called “Shorting the Grid” by Meredith Angwin

her argument is basically that electricity markets are not the right structure to organize our electricity system, and because we have chosen markets as a structured, organized electricity system in many states, we’re giving preferential treatment to natural gas and renewables, two fuels that I think climate activists may feel very different ways about, instead of coal, which she does think we should phase out, and, really, nuclear

By making it easier for renewables and natural gas to kind of accept these side payments, we made them much more profitable and therefore encouraged people to build more of them and therefore underinvested in the forms of generation, such as nuclear, that actually make most of their money by selling electrons to the grid, where they go to people’s homes.

Meanwhile, donors such as Tesla CEO Elon Musk, disgraced FTX founder Sam Bankman-Fried, Skype founder Jaan Tallinn and ethereum co-founder Vitalik Buterin — as well as institutions like Open Philanthropy, a charitable organization started by billionaire Facebook co-founder Dustin Moskovitz — have worked to push doomsayers from the tech industry’s margins into the mainstream.

More recently, wealthy tech philanthropists have begun recruiting an army of elite college students to prioritize the fight against rogue AI over other threats

Other skeptics, like venture capitalist Marc Andreessen, are AI boosters who say that hyping such fears will impede the technology’s progress.

Critics call the AI safety movement unscientific. They say its claims about existential risk can sound closer to a religion than research

And while the sci-fi narrative resonates with public fears about runaway AI, critics say it obsesses over one kind of catastrophe to the exclusion of many others.

Open Philanthropy spokesperson Mike Levine said harms like algorithmic racism deserve a robust response. But he said those problems stem from the same root issue: AI systems not behaving as their programmers intended. The theoretical risks “were not garnering sufficient attention from others — in part because these issues were perceived as speculative,” Levine said in a statement. He compared the nonprofit’s AI focus to its work on pandemics, which also was regarded as theoretical until the coronavirus emerged.

Among the reputational hazards of the AI safety movement is its association with an array of controversial figures and ideas, like EA, which is also known for recruiting ambitious young people on elite college campuses.

The foundation began prioritizing existential risks around AI in 2016,

there was little status or money to be gained by focusing on risks. So the nonprofit set out to build a pipeline of young people who would filter into top companies and agitate for change from the insid

Colleges have been key to this growth strategy, serving as both a pathway to prestige and a recruiting ground for idealistic talent

The clubs train students in machine learning and help them find jobs in AI start-ups or one of the many nonprofit groups dedicated to AI safety.

Many of these newly minted student leaders view rogue AI as an urgent and neglected threat, potentially rivaling climate change in its ability to end human life. Many see advanced AI as the Manhattan Project of their generation

Despite the school’s ties to Silicon Valley, Mukobi said it lags behind nearby UC Berkeley, where younger faculty members research AI alignment, the term for embedding human ethics into AI systems.

Mukobi joined Stanford’s club for effective altruism, known as EA, a philosophical movement that advocates doing maximum good by calculating the expected value of charitable acts, like protecting the future from runaway AI. By 2022, AI capabilities were advancing all around him — wild developments that made those warnings seem prescient.

At Stanford, Open Philanthropy awarded Luby and Edwards more than $1.5 million in grants to launch the Stanford Existential Risk Initiative, which supports student research in the growing field known as “AI safety” or “AI alignment.

from the start EA was intertwined with tech subcultures interested in futurism and rationalist thought. Over time, global poverty slid down the cause list, while rogue AI climbed toward the top.

In the past year, EA has been beset by scandal, including the fall of Bankman-Fried, one of its largest donors

Another key figure, Oxford philosopher Nick Bostrom, whose 2014 bestseller “Superintelligence” is essential reading in EA circles, met public uproar when a decades-old diatribe about IQ surfaced in January.

Programming future AI systems to share human values could mean “an amazing world free from diseases, poverty, and suffering,” while failure could unleash “human extinction or our permanent disempowerment,” Mukobi wrote, offering free boba tea to anyone who attended the 30-minute intro.

Open Philanthropy’s new university fellowship offers a hefty direct deposit: undergraduate leaders receive as much as $80,000 a year, plus $14,500 for health insurance, and up to $100,000 a year to cover group expenses.

Student leaders have access to a glut of resources from donor-sponsored organizations, including an “AI Safety Fundamentals” curriculum developed by an OpenAI employee.

Interest in the topic is also growing among Stanford faculty members, Edwards said. He noted that a new postdoctoral fellow will lead a class on alignment next semester in Stanford’s storied computer science department.

Edwards discovered that shared online forums function like a form of peer review, with authors changing their original text in response to the comments

Mukobi feels energized about the growing consensus that these risks are worth exploring. He heard students talking about AI safety in the halls of Gates, the computer science building, in May after Geoffrey Hinton, another “godfather” of AI, quit Google to warn about AI. By the end of the year, Mukobi thinks the subject could be a dinner-table topic, just like climate change or the war in Ukraine.

Luby, Edwards’s teaching partner for the class on human extinction, also seems to find these arguments persuasive. He had already rearranged the order of his AI lesson plans to help students see the imminent risks from AI. No one needs to “drink the EA Kool-Aid” to have genuine concerns, he said.

Edwards, on the other hand, still sees things like climate change as a bigger threat than rogue AI. But ChatGPT and the rapid release of AI models has convinced him that there should be room to think about AI safety.

Interested students join reading groups where they get free copies of books like “The Precipice,” and may spend hours reading the latest alignment papers, posting career advice on the Effective Altruism forum, or adjusting their P(doom), a subjective estimate of the probability that advanced AI will end badly. The grants, travel, leadership roles for inexperienced graduates and sponsored co-working spaces build a close-knit community.

The course will not be taught by students or outside experts. Instead, he said, it “will be a regular Stanford class.”

The youth unemployment rate is a statistic the Chinese Communist Party takes seriously because it believes that idle young people could threaten its rule. Mao Zedong sent more than 16 million urban youth, including Mr. Xi, to toil in the fields of the countryside during the Cultural Revolution. The return of these jobless young people to cities after the Cultural Revolution, in part, forced the party to embrace self-employment, or jobs outside the state planned economy.

Many people are struggling emotionally. A young woman in Shanghai named Ms. Zhang, who graduated last year with a master’s degree in city planning, has sent out 130 resumes and secured no job offers and only a handful of interviews. Living in a 100-square-foot bedroom in a three-bedroom apartment, she barely gets by with a monthly income of less than $700 as a part-time tutor.“At my emotional low point, I wished I were a robot,” she said. “I thought to myself if I didn’t have emotions, I would not feel helpless, powerless and disappointed. I would be able to keep sending out résumés.”

“To ask us to endure hardships is to try to shift focus from the anemic economic growth and the decreasing job opportunities,” said Ms. Zhang, who, like most people I interviewed for this column, wanted to be identified with only her family name because of safety concerns. A few others want to be identified only with their English names.

Mr. Xi’s instruction to move to the countryside is equally out of touch with young people, as well as with China’s reality. Last December he told officials “to systematically guide college graduates to rural areas.” On Youth Day a few weeks ago, he responded to a letter by a group of agriculture students who are working in rural areas, commending them for “seeking self-inflicted hardships.” The letter, also published on the front page of People’s Daily, triggered discussions about whether Mr. Xi would start a Maoist-style campaign to send urban youths to the countryside.

In the hierarchical Chinese society, manual jobs are looked down upon. Farming ranks even lower because of the huge wealth gap between cities and rural areas. “Women wouldn’t consider to become my girlfriends if they knew that I deliver meals,” said Wang. He would fare even worse in the marriage market if he becomes a farmer.

Out of 13 Chinese graduates from his school, the five who chose to stay in the West have found jobs at Silicon Valley or Wall Street firms. Only three out of the eight who returned to China have secured job offers. Steven moved back to China earlier this year to be closer to his mother.

Now after months of fruitless job hunting, he, like almost every young worker I interviewed for this column, sees no future for himself in China.“My best way out,” he said, “is to persuade my parents to let me run away from China.”

The AI boosters emphasized the incredible potential of their innovation, and Netanyahu raised practical objections to their enthusiasm. They cited futurists such as Ray Kurzweil to paint a bright picture of a post-AI world; Netanyahu cited the Bible and the medieval Jewish philosopher Maimonides to caution against upending human institutions and subordinating our existence to machines.

Musk matter-of-factly explained that the “very positive scenario of AI” is “actually in a lot of ways a description of heaven,” where “you can have whatever you want, you don’t need to work, you have no obligations, any illness you have can be cured,” and death is “a choice.” Netanyahu incredulously retorted, “You want this world?”

By the time the panel began to wind down, the Israeli leader had seemingly made up his mind. “This is like having nuclear technology in the Stone Age,” he said. “The pace of development [is] outpacing what solutions we need to put in place to maximize the benefits and limit the risks.”

Netanyahu was a naysayer about the Arab Spring, unwilling to join the rapturous ranks of hopeful politicians, activists, and democracy advocates. But he was also right.

This was less because he is a prophet and more because he is a pessimist. When it comes to grandiose predictions about a better tomorrow—whether through peace with the Palestinians, a nuclear deal with Iran, or the advent of artificial intelligence—Netanyahu always bets against. Informed by a dark reading of Jewish history, he is a cynic about human nature and a skeptic of human progress.

fter all, no matter how far civilization has advanced, it has always found ways to persecute the powerless, most notably, in his mind, the Jews. For Netanyahu, the arc of history is long, and it bends toward whoever is bending it.

This is why the Israeli leader puts little stock in utopian promises, whether they are made by progressive internationalists or Silicon Valley futurists, and places his trust in hard power instead

“The weak crumble, are slaughtered and are erased from history while the strong, for good or for ill, survive. The strong are respected, and alliances are made with the strong, and in the end peace is made with the strong.”

To his many critics, myself included, Netanyahu’s refusal to envision a different future makes him a “creature of the bunker,” perpetually governed by fear. Although his pessimism may sometimes be vindicated, it also holds his country hostag

In other words, the same cynicism that drives Netanyahu’s reactionary politics is the thing that makes him an astute interrogator of AI and its promoters. Just as he doesn’t trust others not to use their power to endanger Jews, he doesn’t trust AI companies or AI itself to police its rapidly growing capabilities.

Stoics are making a comeback—and they have been for several years. From discussions among Silicon Valley elites to podcasts and newsletters, the school of thought that once flourished in ancient Greece and Rome has been seeing a revival in recent years. The pandemic supercharged this.

men react poorly to loss of status. A 2005 study by the University of Newcastle upon Tyne found that men who experience downward mobility are four times more likely to suffer from depression—and although women are twice as likely to be downwardly mobile, they don’t experience the same drop in well-being.

Today’s backlash against diversity and inclusion efforts can also be seen through this lens: a third leg of men’s status being chopped off.

The Roman Empire did not invent the patriarchy—but it did codify it into law. Pater familias was a legal status that gave the patriarch authority over the family and its estate, two status-granting privileges that contemporary men took for granted but may never achieve

The Roman legal concept of bonus pater familias, or diligens pater familias, became the benchmark for reasonable and diligent behavior when courts seek to establish negligence, from Spain to Canada.

Status (and gender) no longer mattered. What matters is the behavior: Is it that of a proverbial good family father? This has become a stand-in for the standard of care required, underpinning how we may not all think of the Roman Empire all that often, but it’s all around us.

In an age of crises, competence commands a premium—but what we’re getting instead is misogyny, anger, and poor mental health

no wonder that men are vocally demanding to spend more time with their families—perhaps the most potent cure to these struggles.

Today, men are craving answers, purpose, and family. If that’s unachievable, we can expect much worse than fantasies about bygone empires.

With respect to crime, poverty and homelessness, Brown argued,One thing that may occur is that disinvestment in city downtowns will alter the spatial distribution of these elements in cities — i.e. in which neighborhoods or areas of a city is crime more likely, and homelessness more visible. Urban downtowns are often policed such that these visible elements of poverty are pushed to other parts of the city where they will not interfere with commercial activities. But absent these activities, there may be less political pressure to maintain these areas. This is not to say that the overall crime rate or homelessness levels will necessarily increase, but their spatial redistribution may further alter the trajectory of commercial downtowns — and the perception of city crime in the broader public.

“The more dramatic effects on urban geography,” Brown continued,may be how this changes cities in terms of economic and racial segregation. One urban trend from the last couple of decades is young white middle- and upper-class people living in cities at higher rates than previous generations. But if these groups become less likely to live in cities, leaving a poorer, more disproportionately minority population, this will make metropolitan regions more polarized by race/class.

the damage that even the perception of rising crime can inflict on Democrats in a Nov. 27 article, “Meet the Voters Who Fueled New York’s Seismic Tilt Toward the G.O.P.”: “From Long Island to the Lower Hudson Valley, Republicans running predominantly on crime swept five of six suburban congressional seats, including three that President Biden won handily that encompass some of the nation’s most affluent, well-educated commuter towns.

In big cities like New York and San Francisco we estimate large drops in retail spending because office workers are now coming into city centers typically 2.5 rather than 5 days a week. This is reducing business activity by billions of dollars — less lunches, drinks, dinners and shopping by office workers. This will reduce city hall tax revenues.

Public transit systems are facing massive permanent shortfalls as the surge in working from home cuts their revenues but has little impact on costs (as subway systems are mostly a fixed cost. This is leading to a permanent 30 percent drop in transit revenues on the New York Subway, San Francisco Bart, etc.

These difficulties for cities will not go away anytime soon. Bloom provided data showing strong economic incentives for both corporations and their employees to continue the work-from-home revolution if their jobs allow it:

First, “Saved commute time working from home averages about 70 minutes a day, of which about 40 percent (30 minutes) goes into extra work.” Second, “Research finds hybrid working from home increases average productivity around 5 percent and this is growing.” And third, “Employees also really value hybrid working from home, at about the same as an 8 percent pay increase on average.

three other experts in real estate economics, Arpit Gupta, of N.Y.U.’s Stern School of Business, Vrinda Mittal, both of the Columbia Business School, and Van Nieuwerburgh. They anticipate disaster in their September 2022 paper, “Work From Home and the Office Real Estate Apocalypse.”

“Our research,” Gupta wrote by email,emphasizes the possibility of an ‘urban doom loop’ by which decline of work in the center business district results in less foot traffic and consumption, which adversely affects the urban core in a variety of ways (less eyes on the street, so more crime; less consumption; less commuting) thereby lowering municipal revenues, and also making it more challenging to provide public goods and services absent tax increases. These challenges will predominantly hit blue cities in the coming years.

the three authors “revalue the stock of New York City commercial office buildings taking into account pandemic-induced cash flow and discount rate effects. We find a 45 percent decline in office values in 2020 and 39 percent in the longer run, the latter representing a $453 billion value destruction.”

Extrapolating to all properties in the United States, Gupta, Mittal and Van Nieuwerburgh write, the “total decline in commercial office valuation might be around $518.71 billion in the short-run and $453.64 billion in the long-run.”

the share of real estate taxes in N.Y.C.’s budget was 53 percent in 2020, 24 percent of which comes from office and retail property taxes. Given budget balance requirements, the fiscal hole left by declining central business district office and retail tax revenues would need to be plugged by raising tax rates or cutting government spending.

Since March 2020, Manhattan has lost 200,000 households, the most of any county in the U.S. Brooklyn (-88,000) and Queens (-51,000) also appear in the bottom 10. The cities of Chicago (-75,000), San Francisco (-67,000), Los Angeles (-64,000 for the city and -136,000 for the county), Washington DC (-33,000), Seattle (-31,500), Houston (-31,000), and Boston (-25,000) make up the rest of the bottom 10.

Prior to the pandemic, these ecosystems were designed to function based on huge surges in their daytime population from commuters and tourists. The shock of the sudden loss of a big chunk of this population caused a big disruption in the ecosystem.

Just as the pandemic has caused a surge in telework, Loh wrote, “it also caused a huge surge in unsheltered homelessness because of existing flaws in America’s housing system, the end of federally-funded relief measures, a mental health care crisis, and the failure of policies of isolation and confinement to solve the pre-existing homelessness crisis.”

The upshot, Loh continued,is that both the visibility and ratio of people in crisis relative to those engaged in commerce (whether working or shopping) has changed in a lot of U.S. downtowns, which has a big impact on how being downtown ‘feels’ and thus perceptions of downtown.

The nation, Glaeser continued, isat an unusual confluence of trends which poses dangers for cities similar to those experienced in the 1970s. Event#1 is the rise of Zoom, which makes relocation easier even if it doesn’t mean that face-to-face is going away. Event#2 is a hunger to deal with past injustices, including police brutality, mass incarceration, high housing costs and limited upward mobility for the children of the poor.

Progressive mayors, according to Glaeser,have a natural hunger to deal with these problems at the local level, but if they try to right injustices by imposing costs on businesses and the rich, then those taxpayers will just leave. I certainly remember New York and Detroit in the 1960s and 1970s, where the dreams of progressive mayors like John Lindsay and Jerome Patrick Cavanagh ran into fiscal realities.

Richard Florida, a professor of economic analysis and policy at the University of Toronto, stands out as one of the most resolutely optimistic urban scholars. In his August 2022 Bloomberg column, “Why Downtown Won’t Die,”

His answer:

Great downtowns are not reducible to offices. Even if the office were to go the way of the horse-drawn carriage, the neighborhoods we refer to today as downtowns would endure. Downtowns and the cities they anchor are the most adaptive and resilient of human creations; they have survived far worse. Continual works in progress, they have been rebuilt and remade in the aftermaths of all manner of crises and catastrophes — epidemics and plagues; great fires, floods and natural disasters; wars and terrorist attacks. They’ve also adapted to great economic transformations like deindustrialization a half century ago.

Florida wrote that many urban central business districts are “relics of the past, the last gasp of the industrial age organization of knowledge work the veritable packing and stacking of knowledge workers in giant office towers, made obsolete and unnecessary by new technologies.”

“Downtowns are evolving away from centers for work to actual neighborhoods. Jane Jacobs titled her seminal 1957 essay, which led in fact to ‘The Death and Life of Great American Cities,’ ‘Downtown Is for People’ — sounds about right to me.”

Despite his optimism, Florida acknowledged in his email thatAmerican cities are uniquely vulnerable to social disorder — a consequence of our policies toward guns and lack of a social safety net. Compounding this is our longstanding educational dilemma, where urban schools generally lack the quality of suburban schools. American cities are simply much less family-friendly than cities in most other parts of the advanced world. So when people have kids they are more or less forced to move out of America’s cities.

What worries me in all of this, in addition to the impact on cities, is the impact on the American economy — on innovation. and competitiveness. Our great cities are home to the great clusters of talent and innovation that power our economy. Remote work has many advantages and even leads to improvements in some kinds of knowledge work productivity. But America’s huge lead in innovation, finances, entertainment and culture industries comes largely from its great cities. Innovation and advance in. these industries come from the clustering of talent, ideas and knowledge. If that gives out, I worry about our longer-run economic future and living standards.

The risk that comes with fiscal distress is clear: If city governments face budget shortfalls and begin to cut back on funding for public transit, policing, and street outreach, for the maintenance of parks, playgrounds, community centers, and schools, and for services for homelessness, addiction, and mental illness, then conditions in central cities will begin to deteriorate.

There is reason for both apprehension and hope. Cities across time have proven remarkably resilient and have survived infectious diseases from bubonic plague to cholera to smallpox to polio. The world population, which stands today at eight billion people, is 57 percent urban, and because of the productivity, innovation and inventiveness that stems from the creativity of human beings in groups, the urbanization process is quite likely to continue into the foreseeable future. There appears to be no alternative, so we will have to make it work.

In a few short years, effective altruism has become the giving philosophy for many Silicon Valley programmers, hedge funders and even tech billionaires. That includes not just Mr. Bankman-Fried but also the Facebook and Asana co-founder Dustin Moskovitz and his wife, Cari Tuna, who are devoting much of their fortune to the cause.

“If I can help encourage people who do have enormous resources to not buy yachts and instead put that money toward pandemic preparedness and A.I. safety and bed nets and animal welfare that’s just like a really good thing to do,” Mr. MacAskill said.

Mr. Musk has not officially joined the movement but he and Mr. MacAskill have known each other since 2015, when they met at an effective altruism conference. Mr. Musk has also said on Twitter that Mr. MacAskill’s giving philosophy is similar to his own.

Mr. MacAskill was one of the founders of the group Giving What We Can, started at Oxford in 2009. Members promised to give away at least 10 percent of what they earned to the most cost-effective charities possible.

The rise of this kind of thinking, known as longtermism, has meant the Effective Altruists are increasingly associated with causes that have the ring of science fiction to them — like preventing artificial intelligence from running amok or sending people to distant planets to increase our chances of survival as a species

Traditionally, effective altruism was focused on finding the lowest-cost interventions that did the most good. The classic example is insecticide-treated bed nets to prevent mosquitoes from giving people malaria.

Mr. MacAskill argues that people living today have a responsibility not just to people halfway around the world but also those in future generations.

If the movement has an ur-text, it is the Australian philosopher Peter Singer’s article, “Famine, Affluence and Morality,” published in 1972. The essay, which argued that there was no difference morally between the obligation to help a person dying on the street in front of your house and the obligation to help people who were dying elsewhere in the world, emerged as a kind of “sleeper hit” for young people in the past two decades,

The two men first met in 2012, when Mr. Bankman-Fried was a student at M.I.T. with an interest in utilitarian philosophy.

Over lunch, Mr. Bankman-Fried said that he was interested in working on issues related to animal welfare. Mr. MacAskill suggested that he might do more good by entering a high-earning field and donating money to the cause than by working for it directly.

Mr. Bankman-Fried contacted the Humane League and other charities, asking if they would prefer his time or donations based on his expected earnings if he went to work in tech or finance. They opted for the money, and he embarked on a remunerative career, eventually founding the cryptocurrency exchange FTX in 2019.

Bloomberg recently estimated that Mr. Bankman-Fried was worth $10.5 billion, even after the recent crash in crypto prices. That puts Mr. Bankman-Fried in the unusual position of having earned his enormous fortune on behalf of the effective altruism cause, rather than making the money and then searching for a sense of purpose in donating it.

Mr. Bankman-Fried said he expected to give away the bulk of his fortune in the next 10 to 20 years.

Mr. Moskovitz and Ms. Tuna’s net worth is estimated at $12.7 billion. They founded their own group, Good Ventures, in 2011. The group said it had given $1.96 billion in donations

Those two enormous fortunes, along with giving by scores of highly paid engineers at tech companies, mean the community is exceptionally well funded.

Mr. MacAskill said that he got to know Mr. Musk better through Igor Kurganov, a professional poker player and effective altruist, who briefly advised Mr. Musk on philanthropy.

In August, Mr. Musk retweeted Mr. MacAskill’s book announcement to his 108 million followers with the observation: “Worth reading. This is a close match for my philosophy.” Yet instead of wholeheartedly embracing that endorsement as many would, Mr. MacAskill posted a typically earnest and detailed thread in response about some of the places he agreed — and many areas where he disagreed — with Mr. Musk. (They did not see eye to eye on near-term space settlement, for one.)

Mr. MacAskill accepts responsibility for what he calls misconceptions about the community. “I take a significant amount of blame,” he said, “for being a philosopher who was unprepared for this amount of media attention.”

Humanity has “exponentially destroyed life on the same curve as we have exponentially increased intelligence,” he tells his congregants.

Now the “crazy suicide wizards” of Silicon Valley have ushered in another revolution. They have created artificial intelligence.

Forall provides spiritual advice to AI thinkers, and hosts talks and “awakening” retreats for researchers and developers, including employees of OpenAI, Google DeepMind, and Apple. Roughly 50 tech types have done retreats at MAPLE in the past few years

Humans are already destroying life on this planet. AI might soon destroy us.

His monastery is called MAPLE, which stands for the “Monastic Academy for the Preservation of Life on Earth.” The residents there meditate on their breath and on metta, or loving-kindness, an emanation of joy to all creatures.

They meditate in order to achieve inner clarity. And they meditate on AI and existential risk in general—life’s violent, early, and unnecessary end.

There is “no reason” to think AI will preserve humanity, “as if we’re really special,” Forall tells the residents, clad in dark, loose clothing, seated on zafu cushions on the wood floor. “There’s no reason to think we wouldn’t be treated like cattle in factory farms.”

His second is to influence technology by influencing technologists. His third is to change AI itself, seeing whether he and his fellow monks might be able to embed the enlightenment of the Buddha into the code.

In the past few years, MAPLE has become something of the house monastery for people worried about AI and existential risk.

Forall describes the project of creating an enlightened AI as perhaps “the most important act of all time.” Humans need to “build an AI that walks a spiritual path,” one that will persuade the other AI systems not to harm us

we should devote half of global economic output—$50 trillion, give or take—to “that one thing.” We need to build an “AI guru,” he said. An “AI god.”

Forall’s first goal is to expand the pool of humans following what Buddhists call the Noble Eightfold Path.

Forall and many MAPLE residents are what are often called, derisively if not inaccurately, “doomers.”

The seminal text in this ideological lineage is Nick Bostrom’s Superintelligence, which posits that AI could turn humans into gorillas, in a way. Our existence could depend not on our own choices but on the choices of a more intelligent other.

he is spending his life ruminating on AI’s risks, which he sees as far from banal. “We are watching humanist values, and therefore the political systems based on them, such as democracy, as well as the economic systems—they’re just falling apart,” he said. “The ultimate authority is moving from the human to the algorithm.”

Forall’s mother worked for humanitarian nonprofits and his father for conservation nonprofits; the household, which attended Quaker meetings, listened to a lot of NPR.)

He got his answer: Craving is the root of all suffering. And he became ordained, giving up the name Teal Scott and becoming Soryu Forall: “Soryu” meaning something like “a growing spiritual practice” and “Forall” meaning, of course, “for all.”

In 2013, he opened MAPLE, a “modern” monastery addressing the plagues of environmental destruction, lethal weapons systems, and AI, offering co-working and online courses as well as traditional monastic training.

His vision is dire and grand, but perhaps that is why it has found such a receptive audience among the folks building AI, many of whom conceive of their work in similarly epochal terms.

The nonprofit’s revenues have quadrupled, thanks in part to contributions from tech executives as well as organizations such as the Future of Life Institute, co-founded by Jaan Tallinn, a co-creator of Skype.

The donations have helped MAPLE open offshoots—Oak in the Bay Area, Willow in Canada—and plan more. (The highest-paid person at MAPLE is the property manager, who earns roughly $40,000 a year.)

The strictness of the place helps them let go of ego and see the world more clearly, residents told me. “To preserve all life: You can’t do that until you come to love all life, and that has to be trained,

Forall was absolute: Nine countries are armed with nuclear weapons. Even if we stop the catastrophe of climate change, we will have done so too late for thousands of species and billions of beings. Our democracy is fraying. Our trust in one another is fraying

Many of the very people creating AI believe it could be an existential threat: One 2022 survey asked AI researchers to estimate the probability that AI would cause “severe disempowerment” or human extinction; the median response was 10 percent. The destruction, Forall said, is already here.

“It’s important to know that we don’t know what’s going to happen,” he told me. “It’s also important to look at the evidence.” He said it was clear we were on an “accelerating curve,” in terms of an explosion of intelligence and a cataclysm of death. “I don’t think that these systems will care too much about benefiting people. I just can’t see why they would, in the same way that we don’t care about benefiting most animals. While it is a story in the future, I feel like the burden of proof isn’t on me.”