Group items tagged

Have such technological leaps been good? Harari has doubts. Humans have “produced little that we can be proud of,” he complained in Sapiens. His next books, Homo Deus: A Brief History of Tomorrow (2015) and 21 Lessons for the 21st Century (2018), gazed into the future with apprehension

Harari has written another since-the-dawn-of-time overview, Nexus: A Brief History of Information Networks From the Stone Age to AI. It’s his grimmest work yet

Harari rejects the notion that more information leads automatically to truth or wisdom. But it has led to artificial intelligence, whose advent Harari describes apocalyptically. “If we mishandle it,” he warns, “AI might extinguish not only the human dominion on Earth but the light of consciousness itself, turning the universe into a realm of utter darkness.”

Those seeking a precedent for AI often bring up the movable-type printing press, which inundated Europe with books and led, they say, to the scientific revolution. Harari rolls his eyes at this story. Nothing guaranteed that printing would be used for science, he notes

Copernicus’s On the Revolutions of the Heavenly Spheres failed to sell its puny initial print run of about 500 copies in 1543. It was, the writer Arthur Koestler joked, an “all-time worst seller.”

The book that did sell was Heinrich Kramer’s The Hammer of the Witches (1486), which ranted about a supposed satanic conspiracy of sexually voracious women who copulated with demons and cursed men’s penises. The historian Tamar Herzig describes Kramer’s treatise as “arguably the most misogynistic text to appear in print in premodern times.” Yet it was “a bestseller by early modern standards,”

Kramer’s book encouraged the witch hunts that killed tens of thousands. These murderous sprees, Harari observes, were “made worse” by the printing press.

Ampler information flows made surveillance and tyranny worse too, Harari argues. The Soviet Union was, among other things, “one of the most formidable information networks in history,”

Information has always carried this destructive potential, Harari believes. Yet up until now, he argues, even such hellish episodes have been only that: episodes

Demagogic manias like the ones Kramer fueled tend to burn bright and flame out.

States ruled by top-down terror have a durability problem too, Harari explains. Even if they could somehow intercept every letter and plant informants in every household, they’d still need to intelligently analyze all of the incoming reports. No regime has come close to managing this

for the 20th-century states that got nearest to total control, persistent problems managing information made basic governance difficult.

So it was, at any rate, in the age of paper. Collecting data is now much, much easier.

Some people worry that the government will implant a chip in their brain, but they should “instead worry about the smartphones on which they read these conspiracy theories,” Harari writes. Phones can already track our eye movements, record our speech, and deliver our private communications to nameless strangers. They are listening devices that, astonishingly, people are willing to leave by the bedside while having sex.

Harari’s biggest worry is what happens when AI enters the chat. Currently, massive data collection is offset, as it has always been, by the difficulties of data analysis

What defense could there be against an entity that recognized every face, knew every mood, and weaponized that information?

Today’s political deliriums are stoked by click-maximizing algorithms that steer people toward “engaging” content, which is often whatever feeds their righteous rage.

Imagine what will happen, Harari writes, when bots generate that content themselves, personalizing and continually adjusting it to flood the dopamine receptors of each user.

Kramer’s Hammer of the Witches will seem like a mild sugar high compared with the heroin rush of content the algorithms will concoct. If AI seizes command, it could make serfs or psychopaths of us all.

Harari regards AI as ultimately unfathomable—and that is his concern.

Although we know how to make AI models, we don’t understand them. We’ve blithely summoned an “alien intelligence,” Harari writes, with no idea what it will do.

Last year, Harari signed an open letter warning of the “profound risks to society and humanity” posed by unleashing “powerful digital minds that no one—not even their creators—can understand, predict, or reliably control.” It called for a pause of at least six months on training advanced AI systems,

cynics saw the letter as self-serving. It fed the hype by insisting that artificial intelligence, rather than being a buggy product with limited use, was an epochal development. It showcased tech leaders’ Oppenheimer-style moral seriousness

it cost them nothing, as there was no chance their research would actually stop. Four months after signing, Musk publicly launched an AI company.

The economics of the Information Age have been treacherous. They’ve made content cheaper to consume but less profitable to produce. Consider the effect of the free-content and targeted-advertising models on journalism

Since 2005, the United States has lost nearly a third of its newspapers and more than two-thirds of its newspaper jobs, to the point where nearly 7 percent of newspaper employees now work for a single organization, The New York Times

we speak of “news deserts,” places where reporting has essentially vanished.

AI threatens to exacerbate this. With better chatbots, platforms won’t need to link to external content, because they’ll reproduce it synthetically. Instead of a Google search that sends users to outside sites, a chatbot query will summarize those sites, keeping users within Google’s walled garden.

a Truman Show–style bubble: personally generated content, read by voices that sound real but aren’t, plus product placement

this would cut off writers and publishers—the ones actually generating ideas—from readers. Our intellectual institutions would wither, and the internet would devolve into a closed loop of “five giant websites, each filled with screenshots of the other four,” as the software engineer Tom Eastman puts it.

Harari is Silicon Valley’s ideal of what a chatbot should be. He raids libraries, detects the patterns, and boils all of history down to bullet points. (Modernity, he writes, “can be summarised in a single phrase: humans agree to give up meaning in exchange for power.”)

Individual AI models cost billions of dollars. In 2023, about a fifth of venture capital in North America and Europe went to AI. Such sums make sense only if tech firms can earn enormous revenues off their product, by monopolizing it or marketing it. And at that scale, the most obvious buyers are other large companies or governments. How confident are we that giving more power to corporations and states will turn out well?

He discusses it as something that simply happened. Its arrival is nobody’s fault in particular.

In Harari’s view, “power always stems from cooperation between large numbers of humans”; it is the product of society.

like a chatbot, he has a quasi-antagonistic relationship with his sources, an I’ll read them so you don’t have to attitude. He mines other writers for material—a neat quip, a telling anecdote—but rarely seems taken with anyone else’s view

Hand-wringing about the possibility that AI developers will lose control of their creation, like the sorcerer’s apprentice, distracts from the more plausible scenario that they won’t lose control, and that they’ll use or sell it as planned. A better German fable might be Richard Wagner’s The Ring of the Nibelung : A power-hungry incel forges a ring that will let its owner rule the world—and the gods wage war over it.

Harari’s eyes are more on the horizon than on Silicon Valley’s economics or politics.

In Nexus, he proposes four principles. The first is “benevolence,” explained thus: “When a computer network collects information on me, that information should be used to help me rather than manipulate me.”

Harari’s other three values are decentralization of informational channels, accountability from those who collect our data, and some respite from algorithmic surveillance

these are fine, but they are quick, unsurprising, and—especially when expressed in the abstract, as things that “we” should all strive for—not very helpful.

though his persistent first-person pluralizing (“decisions we all make”) softly suggests that AI is humanity’s collective creation rather than the product of certain corporations and the individuals who run them. This obscures the most important actors in the drama—ironically, just as those actors are sapping our intellectual life, hampering the robust, informed debates we’d need in order to make the decisions Harari envisions.

Taking AI seriously might mean directly confronting the companies developing it

Harari slots easily into the dominant worldview of Silicon Valley. Despite his oft-noted digital abstemiousness, he exemplifies its style of gathering and presenting information. And, like many in that world, he combines technological dystopianism with political passivity.

Although he thinks tech giants, in further developing AI, might end humankind, he does not treat thwarting them as an urgent priority. His epic narratives, told as stories of humanity as a whole, do not make much room for such us-versus-them clashes.

He worries that because the technological revolution’s work requires so few laborers, Silicon Valley is creating a tiny ruling class and a teeming, furious “useless class.”

If this is his harrowing warning, then why do Silicon Valley C.E.O.s love him so

When Mr. Harari toured the Bay Area this fall to promote his latest book, the reception was incongruously joyful. Reed Hastings, the chief executive of Netflix, threw him a dinner party. The leaders of X, Alphabet’s secretive research division, invited Mr. Harari over. Bill Gates reviewed the book (“Fascinating” and “such a stimulating writer”) in The New York Times.

it’s insane he’s so popular, they’re all inviting him to campus — yet what Yuval is saying undermines the premise of the advertising- and engagement-based model of their products,

Part of the reason might be that Silicon Valley, at a certain level, is not optimistic on the future of democracy. The more of a mess Washington becomes, the more interested the tech world is in creating something else

he brought up Aldous Huxley. Generations have been horrified by his novel “Brave New World,” which depicts a regime of emotion control and painless consumption. Readers who encounter the book today, Mr. Harari said, often think it sounds great. “Everything is so nice, and in that way it is an intellectually disturbing book because you’re really hard-pressed to explain what’s wrong with it,” he said. “And you do get today a vision coming out of some people in Silicon Valley which goes in that direction.”

The story of his current fame begins in 2011, when he published a book of notable ambition: to survey the whole of human existence. “Sapiens: A Brief History of Humankind,” first released in Hebrew, did not break new ground in terms of historical research. Nor did its premise — that humans are animals and our dominance is an accident — seem a likely commercial hit. But the casual tone and smooth way Mr. Harari tied together existing knowledge across fields made it a deeply pleasing read, even as the tome ended on the notion that the process of human evolution might be over.

He followed up with “Homo Deus: A Brief History of Tomorrow,” which outlined his vision of what comes after human evolution. In it, he describes Dataism, a new faith based around the power of algorithms. Mr. Harari’s future is one in which big data is worshiped, artificial intelligence surpasses human intelligence, and some humans develop Godlike abilities.

Now, he has written a book about the present and how it could lead to that future: “21 Lessons for the 21st Century.” It is meant to be read as a series of warnings. His recent TED Talk was called “Why fascism is so tempting — and how your data could power it.”

At the Alphabet talk, Mr. Harari had been accompanied by his publisher. They said that the younger employees had expressed concern about whether their work was contributing to a less free society, while the executives generally thought their impact was positive

Some workers had tried to predict how well humans would adapt to large technological change based on how they have responded to small shifts, like a new version of Gmail. Mr. Harari told them to think more starkly: If there isn’t a major policy intervention, most humans probably will not adapt at all.

It made him sad, he told me, to see people build things that destroy their own societies, but he works every day to maintain an academic distance and remind himself that humans are just animals. “Part of it is really coming from seeing humans as apes, that this is how they behave,” he said, adding, “They’re chimpanzees. They’re sapiens. This is what they do.”

this summer, Mark Zuckerberg, who has recommended Mr. Harari to his book club, acknowledged a fixation with the autocrat Caesar Augustus. “Basically,” Mr. Zuckerberg told The New Yorker, “through a really harsh approach, he established 200 years of world peace.”

He said he had resigned himself to tech executives’ global reign, pointing out how much worse the politicians are. “I’ve met a number of these high-tech giants, and generally they’re good people,” he said. “They’re not Attila the Hun. In the lottery of human leaders, you could get far worse.”

Some of his tech fans, he thinks, come to him out of anxiety. “Some may be very frightened of the impact of what they are doing,” Mr. Harari said

as he spoke about meditation — Mr. Harari spends two hours each day and two months each year in silence — he became commanding. In a region where self-optimization is paramount and meditation is a competitive sport, Mr. Harari’s devotion confers hero status.

He told the audience that free will is an illusion, and that human rights are just a story we tell ourselves. Political parties, he said, might not make sense anymore. He went on to argue that the liberal world order has relied on fictions like “the customer is always right” and “follow your heart,” and that these ideas no longer work in the age of artificial intelligence, when hearts can be manipulated at scale.

Everyone in Silicon Valley is focused on building the future, Mr. Harari continued, while most of the world’s people are not even needed enough to be exploited. “Now you increasingly feel that there are all these elites that just don’t need me,” he said. “And it’s much worse to be irrelevant than to be exploited.”

The useless class he describes is uniquely vulnerable. “If a century ago you mounted a revolution against exploitation, you knew that when bad comes to worse, they can’t shoot all of us because they need us,” he said, citing army service and factory work.

Now it is becoming less clear why the ruling elite would not just kill the new useless class. “You’re totally expendable,” he told the audience.

This, Mr. Harari told me later, is why Silicon Valley is so excited about the concept of universal basic income, or stipends paid to people regardless of whether they work. The message is: “We don’t need you. But we are nice, so we’ll take care of you.”

On Sept. 14, he published an essay in The Guardian assailing another old trope — that “the voter knows best.”

“If humans are hackable animals, and if our choices and opinions don’t reflect our free will, what should the point of politics be?” he wrote. “How do you live when you realize … that your heart might be a government agent, that your amygdala might be working for Putin, and that the next thought that emerges in your mind might well be the result of some algorithm that knows you better than you know yourself? These are the most interesting questions humanity now faces.”

Today, they have a team of eight based in Tel Aviv working on Mr. Harari’s projects. The director Ridley Scott and documentarian Asif Kapadia are adapting “Sapiens” into a TV show, and Mr. Harari is working on children’s books to reach a broader audience.

Being gay, Mr. Harari said, has helped his work — it set him apart to study culture more clearly because it made him question the dominant stories of his own conservative Jewish society. “If society got this thing wrong, who guarantees it didn’t get everything else wrong as well?” he said

“If I was a superhuman, my superpower would be detachment,” Mr. Harari added. “O.K., so maybe humankind is going to disappear — O.K., let’s just observe.”

They just finished “Dear White People,” and they loved the Australian series “Please Like Me.” That night, they had plans to either meet Facebook executives at company headquarters or watch the YouTube show “Cobra Kai.”

Harari: What do Jews do for the next 2,000 years? They learn—they sit in Yavne and they learn

Beckerman: It turned from a religion based on priests and temples and sacrifices into a religion of learning, right?

For me, the birth scene of Judaism is Rabbi Yohanan ben Zakkai, one of the great sages, fleeing Jerusalem and coming to the Roman general Vespasian, who later became Roman emperor, and asking him for a favor: “Please give me Yavne and its wise men.” And Vespasian agrees. This is myth more than history. But this is the founding myth of Judaism. Yavne was a small town not far from present-day Tel Aviv, and that was where ben Zakkai established a learning center, and it changed the nature of Judaism.

Harari: I would say that the other side is Zionist, and it’s important to emphasize and reclaim this word, which has been vilified, not just now, but for decades.

Vespasian could have told ben Zakkai. Why did it take 2,000 years of learning in yeshivas to go back to that same moment and basically adopt the values of the Roman legion? Because if I think about what the values are of people like Itamar Ben Gvir, Bezalel Smotrich, Netanyahu—it’s the values of the Roman legion.

Beckerman: So if Netanyahu and his partners on the extreme right are the Zealots, how do you see the other side—yourself—in this battle for the soul of Israel?

eventually the circle is almost closed. They come back. They come back to Jerusalem. And the Zealots have now taken over Jerusalem again. And the question that keeps bothering me: What did Jews learn in those 2,000 years?

Zionism is simply the national movement of the Jewish people. And if you think that Zionism is racist and is abhorrent, you’re basically saying that Jews don’t deserve to have national feelings

Zionism basically says three simple things that should be uncontroversial. It says that the Jews are a nation, not just isolated individuals. There is a Jewish people. The second thing Zionism says is that, like all other peoples, the Jewish people also have a right to self-determination, like the Palestinians, like the Turks, like the Poles. And the third thing it says is the Jews have a deep historical, cultural, spiritual connection to the land between the Jordan River and the Mediterranean, which is a historical fact.

Harari: What the political conclusion is from these three facts, that’s up for grabs. And throughout Zionist history, for the past 150 years, people had different ideas.

You can acknowledge that there is a Jewish people. It has a right to self-determination. It has a historical connection to the country. And at the same time, there is a Palestinian people. It also has a right to self-determination, and it also has deep historical, spiritual, cultural connection to the land between the Mediterranean and the Jordan River.

now the political question is, what do you do with these two facts? And there are potential solutions, a two-state solution, which you can argue, where exactly will the border pass and what will be the rights of Palestinians who remain in Israeli territory? And we can discuss all that

basically, Zionism doesn’t deny the existence and rights of Palestinian people.

Beckerman: Do you think that Israelis’ capacity for empathy has been degraded over the past year?

So I shout harder, and like any attention given to the pain of the other person, I feel it as an attack on me, because it has repercussions. I will suffer.

Beckerman: One of the other things I’ve been struggling with this past year has been the inability of most people to contain more than one narrative in their minds—like the two narratives you just described

Harari: This is one of the things that wars do. This is not unique to Israelis. When there is a war, the first few casualties get so much attention. The millionth casualty, it’s just a number. And this is one of the biggest dangers with the current war, is this process of desensitizing people, brutalizing people.

now the police are beating up the families of the hostages. The people spit at them. People curse them. There is a propaganda campaign against them through the right-wing media.

Harari: It bothers me, and at the same time, as a historian, unfortunately it makes sense; it’s humanity. Most people have no capacity to empathize with the suffering of the other side, partly because it’s like a resource that is exhausted.

Harari: To some extent, every peace needs justice and every justice needs peace. But they are different ways of looking at reality, at history. Every peace deal in history required giving up some justice. You can’t have absolute justice. Peace is more objective

people have very, very different concepts of what justice means to them. So if you try to gain absolute justice, you will never have peace. You cannot go back and bring the dead to life

The only change you can make is in the present. How do we make sure that more people are not killed and injured now and in the future?

Beckerman: I’m curious what you think about the pro-Palestinian protests here and why they have been so compelling, in particular, to young people

Harari: Obviously, as often happens, you project your own problems, your own issues, onto a distant conflict. And many times, people don’t really understand the conflict. I see it especially with this projection of the colonialist interpretation. People take this model, which is very central in the United States and other Western countries, and impose it on a completely different situation. And they say, Okay, the Israelis are the white Europeans who came to colonize the indigenous Palestinians. And there are some kernels of truth in this, but it’s a wrong model.

For 2,000 years, Jews were one of the chief victims of European civilization, and suddenly now they become the Europeans? This also ignores the fact that more than 50 percent of Israeli Jews are not European

Harari: Yes, and then even after everything that has happened with October 7 and the war, Netanyahu and his colleagues are still at it. You know, he has not taken any responsibility for October 7. I don’t hold him responsible for every decision of some company commander in the army and so forth. But the prime minister, the leader of the country, has one major responsibility—to set the priorities. He decided that the No. 1 problem with Israel is the supreme court. The priority is to destroy the supreme court. And this is his responsibility, nobody else’s. And if he, if Israel had given a quarter of the attention that was given to the supreme court to Hamas, there would have been no October 7.

The Israeli nation is collapsing, the patriotic bonds that hold the nation together are being torn deliberately by Netanyahu and his colleagues. He is the most hated person in the history of Israel. Like 50 percent of the people just hate him on a level that is unimaginable. I think the No. 1 responsibility of a leader, especially for a country in such existential danger as Israel, is to unify

People here ask me, Should Jews vote for Donald Trump? Should Jews vote for Kamala Harris? Who is better for the Jewish people? The key question is, what are the values of the Jewish people? Are the values of the Jewish people those of a bully who sees the world simply as a power game, where you need to subdue and win over everybody else?

Harari: Israel is facing a real existential threat from Iran and its proxies, and it’s no secret. They say it openly: They want to destroy Israel. What I think is that the United States should continue to support Israel, but demand something. Here, I am with Trump. You know this transactional worldview. You give so much money. Make some conditions for what Israel should do in exchange; use the leverage.

The second argues that the digital network is both quantitatively and qualitatively different from the print network that created modern democratic societies

All “true believers” are delusional. Anyone who calls a religion “a true representation of reality” is “lying.”

Information, Mr. Harari writes, creates a “social nexus” among its users. The “twin pillars” of society are bureaucracy, which creates power by centralizing information, and mythology, which creates power by controlling the dispersal of “stories” and “brands.”

Societies cohere around stories such as the Bible and communism and “personality cults” and brands such as Jesus and Stalin.

The third presents the AI apocalypse. An “alien” information network gone rogue, Mr. Harari warns, could “supercharge existing human conflicts,” leading to an “AI arms race” and a digital Cold War, with rival powers divided by a Silicon Curtain of chips and code.

“Subjective facts” based on “beliefs and feelings” cannot be true. The collaborative cacophony of “intersubjective reality,” the darkling plain of social and political contention where all our minds meet, also cannot be fully true.

Mr. Harari agrees that “truth is an accurate representation of reality” but argues that only “objective facts” such as scientific data are true

When the attempt is convincing, the naive “call it truth.”

Digitizing our naivety has, Mr. Harari believes, made us uncontrollable and incorrigible

He consistently confuses democracy (a method of gauging opinion with a long history) with liberalism (a mostly Anglo-American legal philosophy with a short history).

Digital networks overwhelm us with information, but computers can only create “order,” not “truth” or “wisdom.”

AI might take over without developing human-style consciousness: “Intelligence is enough.”

The nexus of machine-learning, algorithmic “user engagement” and human nature could mean that “large-scale democracies may not survive the rise of computer technology.”

The “main split” in 20th-century information was between closed, pseudo-infallible “totalitarian” systems and open, self-correcting “democratic” systems.

after the flood of digital information, the split will be between humans and machines

The machines will still be fallible.

Will they allow us to correct them

Mr. Harari nevertheless argues that “social media algorithms” play such a “divisive” role that free speech has become a naive luxury, unaffordable in the age of AI. He “strongly disagrees” with Louis Brandeis’s opinion in Whitney v. California (1927) that the best way to combat false speech is with more speech.

The survival of democracy requires “regulatory institutions” that will “vet algorithms,” counter “conspiracy theories” and prevent the rise of “charismatic leaders.”

Unfortunately, his grasp of politics is tenuous and hyperbolic. He seems to believe that populism was invented with the iPhone rather than being a recurring bug that appears when democratic operating systems become corrupted or fail to update their software

Mythologies of religion, history and ideology, Mr. Harari believes, exploit our naive tendency to mistake all information as “an attempt to represent reality.

He defines democracy as “an ongoing conversation between diverse information nodes,”

but the openness of the conversation and the independence of its nodes derive from liberalism’s rights of individual privacy and speech. Yet “liberalism” appears nowhere in “Nexus.

Mr. Harari isn’t much concerned with liberty and justice either.

Nexus” is a mirror to the unease of our experts and elites. It divides people into the cognitively unfit and the informationally pure and proposes we divide power over speech accordingly

Call me naive, but Mr. Harari’s technocratic TED-talking is not the way to save democracy. It is the royal road to tyranny.

Systems that are self-correcting — because they promote conversation and mutuality — are preferable to those that offer only blind, disenfranchised subservience.

The meat of “Nexus” is essentially an extended policy brief on A.I.: What are its risks, and what can be done?

The threats A.I. poses are not the ones that filmmakers visualize:

All of this is sort of obvious-interesting, while also being too vague — too open to objection and counterexample — to constitute a useful theory of information.

Or the outsourcing of human judgment — legal, financial or military decision-making — to an A.I. whose complexity becomes impenetrable to our own understanding.

Harari warns of a “Silicon Curtain” descending between us and the algorithms we have created, shutting us out of our own conversations — how we want to act, or interact, or govern ourselves.

None of these scenarios, however, is a given. Harari points to the problem of email spam

In 2015, Google was able to claim that its Gmail algorithm had a 99.9 percent success rate in blocking genuine spam. “When the tech giants set their hearts on designing better algorithms,” writes Harari, “they can usually do it.”

Parts of “Nexus” are wise and bold. They remind us that democratic societies still have the facilities to prevent A.I.’s most dangerous excesses, and that it must not be left to tech companies and their billionaire owners to regulate themselves.

Anton’s critique was that I was half-right and half-wrong. I was right to see democracy degenerating into tyranny but wrong to see any way to avoid it. What he calls “Caesarism” is already here, as Obama’s abuse of executive power proved. Therefore: “If we must have Caesar, who do you want him to be? One of theirs? Or one of yours (ours)?”

he writes a reactionary blog, Unqualified Reservations, under the pseudonym Mencius Moldbug and has earned a cult following among the alt-right. His magnum opus — “An Open Letter to Open-Minded Progressives” — is an alternately chilling and entertaining assault on almost everything educated Westerners hold to be self-evidently true.

Yarvin believes that the Western mind became corrupted during the Enlightenment itself. The very idea of democracy, allied with reason and constitutionalism, is bunk: “Washington has failed. The Constitution has failed. Democracy has failed.” His golden era: the age of monarchs. (“It is hard not to imagine that world as happier, wealthier, freer, more civilized, and more pleasant.”) His solution: “It is time for restoration, for national salvation, for a full reboot. We need a new government, a clean slate, a fresh hand which is smart, strong and fair.”

The assumption that all of history has led inexorably to today’s glorious and democratic present is, he argues, a smug and self-serving delusion. It’s what used to be called Whig History, the idea that all of human history led up to the democratic institutions and civilizational achievements of liberal Britain, the model for the entire world.

Why do so many of us assume that progress is inevitable, if never complete? Yarvin, like the Claremonters and American Greatness brigade, blames an elite that he calls by the inspired name “the Cathedral,” an amalgam of established universities and the mainstream press. It works like this: “The universities make decisions, for which the press manufactures consent.

for Yarvin, the consent is manufactured not by capitalism, advertising, and corporations but by liberal academics, pundits, and journalists. They simply assume that left liberalism is the only rational response to the world. Democracy, he contends, “no longer means that the public’s elected representatives control the government. It means that the government implements scientific public policy in the public interest.”

His solution is not just a tyrannical president who hates all that the Cathedral stands for but something even more radical: “the liquidation of democracy, the Constitution and the rule of law, and the transfer of absolute power to a mysterious figure known only as the Receiver, who in the process of converting Washington into a heavily armed, ultra-profitable corporation will abolish the press, smash the universities, sell the public schools, and transfer ‘decivilized populations’ to ‘secure relocation facilities’ where they will be assigned to ‘mandatory apprenticeships.’ ”

This is 21st-century fascism, except that Yarvin’s Receiver would allow complete freedom of speech and association and would exercise no control over economic life. Foreign policy? Yarvin calls for “a total shutdown of international relations, including security guarantees, foreign aid, and mass immigration.” All social policy also disappears: “I believe that government should take no notice whatsoever of race — no racial policy. I believe it should separate itself completely from the question of what its citizens should or should not think — separation of education and state.”

I never doubted the cogency of many reactionary insights — and I still admire minds that have not succumbed to the comfortable assumption that the future is always brighter. I read the Christian traditionalist Rod Dreher with affection. His evocation of Christian life and thought over the centuries and his panic at its disappearance from our world are poignant. We are losing a vast civilization that honed answers to the deepest questions that human beings can ask, replacing it with vapid pseudo-religions, pills, therapy, and reality TV

Because in some key respects, reactionaries are right. Great leaps forward in history are often, in fact, giant leaps back. The Reformation did initiate brutal sectarian warfare. The French Revolution did degenerate into barbarous tyranny. Communist utopias — allegedly the wave of an Elysian future — turned into murderous nightmares. Modern neoliberalism has, for its part, created a global capitalist machine that is seemingly beyond anyone’s control, fast destroying the planet’s climate, wiping out vast tracts of life on Earth while consigning millions of Americans to economic stagnation and cultural despair.

And at an even deeper level, the more we discover about human evolution, the more illusory certain ideas of progress become. In his book Sapiens, Yuval Noah Harari points out that hunter-gatherers were actually up to six inches taller than their more “civilized” successors; their diets were much healthier; infectious disease was much rarer; they worked less and goofed off more than we do.

Harari notes another paradox: Over hundreds of millennia, we have overcome starvation … but now are more likely to die of obesity than hunger. Happiness? Globally, suicide rates keep rising.

We are tribal creatures in our very DNA; we have an instinctive preference for our own over others, for “in-groups” over “out-groups”; for hunter-gatherers, recognizing strangers as threats was a matter of life and death

We also invent myths and stories to give meaning to our common lives. Among those myths is the nation — stretching from the past into the future, providing meaning to our common lives in a way nothing else can. Strip those narratives away, or transform them too quickly, and humans will become disoriented. Most of us respond to radical changes in our lives, especially changes we haven’t chosen, with more fear than hope

If we ignore these deeper facts about ourselves, we run the risk of fatal errors. It’s vital to remember that multicultural, multiracial, post-national societies are extremely new for the human species, and keeping them viable and stable is a massive challenge.

Globally, social trust is highest in the homogeneous Nordic countries, and in America, Pew has found it higher in rural areas than cities. The political scientist Robert Putnam has found that “people living in ethnically diverse settings appear to ‘hunker down,’ that is, to pull in like a turtle.” Not very encouraging about human nature — but something we can’t wish away, either

In fact, the American elite’s dismissal of these truths, its reduction of all resistance to cultural and demographic change as crude “racism” or “xenophobia,” only deepens the sense of siege many other Americans feel.

When this velocity of cultural change combines with a deepening — and accurate — sense of economic anxiety, is it shocking that human beings want to retreat into a past, to resuscitate the nation-state, and to reach backward for a more primeval and instinctual group identity? Or that they doubt the promise of “progress” and seek scapegoats in the governing classes that have encouraged all of this to happen?

The tragedy of our time, of course, is that President Obama tried to follow Lincoln’s advice. He reached out to those who voted against him as often as he could. His policies, like Obamacare, were aimed at helping the very working poor who gave Trump the White House. He pledged to transcend the red-blue divide. He acknowledged both the necessity of law enforcement and the legitimate African-American fear of hostile cops

A black man brought up by white people, he gave speech after speech attempting to provide a new narrative for America: one of slowly integrating moral progress, where racial and class divides could be overcome. He criticized the reductive divisiveness of identity politics. And yet he failed

he couldn’t stem the reactionary tide that now washes ever closer ashore. If a man that talented, with that biography, found himself spitting into the wind, a powerful storm is indeed upon us.

how can you seriously regard our political system and culture as worse than ever before in history? How self-centered do you have to be to dismiss the unprecedented freedom for women, racial minorities, and homosexuals? Or the increased security for the elderly and unemployed, and the greater access to health care by the poor and now the working poor? Compare the air we breathe today with that of the 1950s. Contrast the religious tolerance we take for granted today with the enmities of the past.

Over the very long haul, too, scholars such as Steven Pinker have found convincing evidence that violence among humans is at the lowest levels since the species first emerged.

It is also one thing to be vigilant about the power of the administrative state and to attempt to reform and modernize it; it is quite another to favor its abolition. The more complex modern society has become, the more expertise is needed to govern it — and where else is that expertise going to come from if not a professional elite?

the liberal media has nothing like the monopoly it once enjoyed. There are two “Cathedrals” in the 21st century — and only one has helped produce a conservative Supreme Court, a Republican Congress, a Republican president, and near-record Republican majorities in statehouses around the country

Beyond all that, neo-reactionaries have a glaring problem, which is that their proposed solutions are so radical they have no chance whatsoever of coming into existence — and would be deeply reckless to attempt.

There is, perhaps, a way to use reactionary insights and still construct a feasible center-right agenda. Such a program would junk Reaganite economics as outdated but keep revenue-neutral tax reform, it could even favor redistribution to counter the deep risk to democracy that soaring inequality fosters, and it could fix Obamacare’s technical problems. You could add to this mix stronger border control, a reduction in legal immigration, a pause in free-trade expansion, a technological overhaul of the government bureaucracy, and a reassertion of Americanism over multiculturalism.

The left, for its part, must, it seems to me, escape its own bubble and confront the accelerating extremism of its identity politics and its disdain for millions of “deplorable” white Americans. You will not arrest the reactionary momentum by ignoring it or dismissing it entirely as a function of bigotry or stupidity. You’ll only defuse it by appreciating its insights and co-opting its appeal.

We are also producing ever more powerful weapons of mass destruction, from thermonuclear bombs to doomsday viruses. Our leaders don’t lack information about these dangers, yet instead of collaborating to find solutions, they are edging closer to a global war.

Despite – or perhaps because of – our hoard of data, we are continuing to spew greenhouse gases into the atmosphere, pollute rivers and oceans, cut down forests, destroy entire habitats, drive countless species to extinction, and jeopardise the ecological foundations of our own species

For most of our networks have been built and maintained by spreading fictions, fantasies and mass delusions – ranging from enchanted broomsticks to financial systems. Our problem, then, is a network problem. Specifically, it is an information problem. For information is the glue that holds networks together, and when people are fed bad information they are likely to make bad decisions, no matter how wise and kind they personally are.

Traditionally, the term “AI” has been used as an acronym for artificial intelligence. But it is perhaps better to think of it as an acronym for alien intelligence

AI is an unprecedented threat to humanity because it is the first technology in history that can make decisions and create new ideas by itself. All previous human inventions have empowered humans, because no matter how powerful the new tool was, the decisions about its usage remained in our hands

Nuclear bombs do not themselves decide whom to kill, nor can they improve themselves or invent even more powerful bombs. In contrast, autonomous drones can decide by themselves who to kill, and AIs can create novel bomb designs, unprecedented military strategies and better AIs.

AI isn’t a tool – it’s an agent. The biggest threat of AI is that we are summoning to Earth countless new powerful agents that are potentially more intelligent and imaginative than us, and that we don’t fully understand or control.

repreneurs such as Yoshua Bengio, Geoffrey Hinton, Sam Altman, Elon Musk and Mustafa Suleyman have warned that AI could destroy our civilisation. In a 2023 survey of 2,778 AI researchers, more than a third gave at least a 10% chance of advanced AI leading to outcomes as bad as human extinction.

As AI evolves, it becomes less artificial (in the sense of depending on human designs) and more alien

AI isn’t progressing towards human-level intelligence. It is evolving an alien type of intelligence.

generative AIs like GPT-4 already create new poems, stories and images. This trend will only increase and accelerate, making it more difficult to understand our own lives. Can we trust computer algorithms to make wise decisions and create a better world? That’s a much bigger gamble than trusting an enchanted broom to fetch water

it is more than just human lives we are gambling on. AI is already capable of producing art and making scientific discoveries by itself. In the next few decades, it will be likely to gain the ability even to create new life forms, either by writing genetic code or by inventing an inorganic code animating inorganic entities. AI could therefore alter the course not just of our species’ history but of the evolution of all life forms.

“Then … came move number 37,” writes Suleyman. “It made no sense. AlphaGo had apparently blown it, blindly following an apparently losing strategy no professional player would ever pursue. The live match commentators, both professionals of the highest ranking, said it was a ‘very strange move’ and thought it was ‘a mistake’.

as the endgame approached, that ‘mistaken’ move proved pivotal. AlphaGo won again. Go strategy was being rewritten before our eyes. Our AI had uncovered ideas that hadn’t occurred to the most brilliant players in thousands of years.”

“In AI, the neural networks moving toward autonomy are, at present, not explainable. You can’t walk someone through the decision-making process to explain precisely why an algorithm produced a specific prediction. Engineers can’t peer beneath the hood and easily explain in granular detail what caused something to happen. GPT‑4, AlphaGo and the rest are black boxes, their outputs and decisions based on opaque and impossibly intricate chains of minute signals.”

Yet during all those millennia, human minds have explored only certain areas in the landscape of Go. Other areas were left untouched, because human minds just didn’t think to venture there. AI, being free from the limitations of human minds, discovered and explored these previously hidden areas.

Second, move 37 demonstrated the unfathomability of AI. Even after AlphaGo played it to achieve victory, Suleyman and his team couldn’t explain how AlphaGo decided to play it.

Move 37 is an emblem of the AI revolution for two reasons. First, it demonstrated the alien nature of AI. In east Asia, Go is considered much more than a game: it is a treasured cultural tradition. For more than 2,500 years, tens of millions of people have played Go, and entire schools of thought have developed around the game, espousing different strategies and philosophies

The rise of unfathomable alien intelligence poses a threat to all humans, and poses a particular threat to democracy. If more and more decisions about people’s lives are made in a black box, so voters cannot understand and challenge them, democracy ceases to functio

Human voters may keep choosing a human president, but wouldn’t this be just an empty ceremony? Even today, only a small fraction of humanity truly understands the financial system

As the 2007‑8 financial crisis indicated, some complex financial devices and principles were intelligible to only a few financial wizards. What happens to democracy when AIs create even more complex financial devices and when the number of humans who understand the financial system drops to zero?

Translating Goethe’s cautionary fable into the language of modern finance, imagine the following scenario: a Wall Street apprentice fed up with the drudgery of the financial workshop creates an AI called Broomstick, provides it with a million dollars in seed money, and orders it to make more money.

n pursuit of more dollars, Broomstick not only devises new investment strategies, but comes up with entirely new financial devices that no human being has ever thought about.

many financial areas were left untouched, because human minds just didn’t think to venture there. Broomstick, being free from the limitations of human minds, discovers and explores these previously hidden areas, making financial moves that are the equivalent of AlphaGo’s move 37.

For a couple of years, as Broomstick leads humanity into financial virgin territory, everything looks wonderful. The markets are soaring, the money is flooding in effortlessly, and everyone is happy. Then comes a crash bigger even than 1929 or 2008. But no human being – either president, banker or citizen – knows what caused it and what could be done about it

AI, too, is a global problem. Accordingly, to understand the new computer politics, it is not enough to examine how discrete societies might react to AI. We also need to consider how AI might change relations between societies on a global level.

As long as humanity stands united, we can build institutions that will regulate AI, whether in the field of finance or war. Unfortunately, humanity has never been united. We have always been plagued by bad actors, as well as by disagreements between good actors. The rise of AI poses an existential danger to humankind, not because of the malevolence of computers, but because of our own shortcomings.

errorists might use AI to instigate a global pandemic. The terrorists themselves may have little knowledge of epidemiology, but the AI could synthesise for them a new pathogen, order it from commercial laboratories or print it in biological 3D printers, and devise the best strategy to spread it around the world, via airports or food supply chain

desperate governments request help from the only entity capable of understanding what is happening – Broomstick. The AI makes several policy recommendations, far more audacious than quantitative easing – and far more opaque, too. Broomstick promises that these policies will save the day, but human politicians – unable to understand the logic behind Broomstick’s recommendations – fear they might completely unravel the financial and even social fabric of the world. Should they listen to the AI?

Human civilisation could also be devastated by weapons of social mass destruction, such as stories that undermine our social bonds. An AI developed in one country could be used to unleash a deluge of fake news, fake money and fake humans so that people in numerous other countries lose the ability to trust anything or anyone.

Many societies – both democracies and dictatorships – may act responsibly to regulate such usages of AI, clamp down on bad actors and restrain the dangerous ambitions of their own rulers and fanatics. But if even a handful of societies fail to do so, this could be enough to endanger the whole of humankind

Thus, a paranoid dictator might hand unlimited power to a fallible AI, including even the power to launch nuclear strikes. If the AI then makes an error, or begins to pursue an unexpected goal, the result could be catastrophic, and not just for that country

magine a situation – in 20 years, say – when somebody in Beijing or San Francisco possesses the entire personal history of every politician, journalist, colonel and CEO in your country: every text they ever sent, every web search they ever made, every illness they suffered, every sexual encounter they enjoyed, every joke they told, every bribe they took. Would you still be living in an independent country, or would you now be living in a data colony?

What happens when your country finds itself utterly dependent on digital infrastructures and AI-powered systems over which it has no effective control?

In the economic realm, previous empires were based on material resources such as land, cotton and oil. This placed a limit on the empire’s ability to concentrate both economic wealth and political power in one place. Physics and geology don’t allow all the world’s land, cotton or oil to be moved to one country

t is different with the new information empires. Data can move at the speed of light, and algorithms don’t take up much space. Consequently, the world’s algorithmic power can be concentrated in a single hub. Engineers in a single country might write the code and control the keys for all the crucial algorithms that run the entire world.

AI and automation therefore pose a particular challenge to poorer developing countries. In an AI-driven global economy, the digital leaders claim the bulk of the gains and could use their wealth to retrain their workforce and profit even more

Meanwhile, the value of unskilled labourers in left-behind countries will decline, causing them to fall even further behind. The result might be lots of new jobs and immense wealth in San Francisco and Shanghai, while many other parts of the world face economic ruin.

AI is expected to add $15.7tn (£12.3tn) to the global economy by 2030. But if current trends continue, it is projected that China and North America – the two leading AI superpowers – will together take home 70% of that money.

uring the cold war, the iron curtain was in many places literally made of metal: barbed wire separated one country from another. Now the world is increasingly divided by the silicon curtain. The code on your smartphone determines on which side of the silicon curtain you live, which algorithms run your life, who controls your attention and where your data flows.

Cyberweapons can bring down a country’s electric grid, but they can also be used to destroy a secret research facility, jam an enemy sensor, inflame a political scandal, manipulate elections or hack a single smartphone. And they can do all that stealthily. They don’t announce their presence with a mushroom cloud and a storm of fire, nor do they leave a visible trail from launchpad to target

The two digital spheres may therefore drift further and further apart. For centuries, new information technologies fuelled the process of globalisation and brought people all over the world into closer contact. Paradoxically, information technology today is so powerful it can potentially split humanity by enclosing different people in separate information cocoons, ending the idea of a single shared human reality

For decades, the world’s master metaphor was the web. The master metaphor of the coming decades might be the cocoon.

Other countries or blocs, such as the EU, India, Brazil and Russia, may try to create their own digital cocoons,

Instead of being divided between two global empires, the world might be divided among a dozen empires.

The more the new empires compete against one another, the greater the danger of armed conflict.

The cold war between the US and the USSR never escalated into a direct military confrontation, largely thanks to the doctrine of mutually assured destruction. But the danger of escalation in the age of AI is bigger, because cyber warfare is inherently different from nuclear warfare.

US companies are now forbidden to export such chips to China. While in the short term this hampers China in the AI race, in the long term it pushes China to develop a completely separate digital sphere that will be distinct from the American digital sphere even in its smallest buildings.

The temptation to start a limited cyberwar is therefore big, and so is the temptation to escalate it.

A second crucial difference concerns predictability. The cold war was like a hyper-rational chess game, and the certainty of destruction in the event of nuclear conflict was so great that the desire to start a war was correspondingly small

Cyberwarfare lacks this certainty. Nobody knows for sure where each side has planted its logic bombs, Trojan horses and malware. Nobody can be certain whether their own weapons would actually work when called upon

Such uncertainty undermines the doctrine of mutually assured destruction. One side might convince itself – rightly or wrongly – that it can launch a successful first strike and avoid massive retaliation

Even if humanity avoids the worst-case scenario of global war, the rise of new digital empires could still endanger the freedom and prosperity of billions of people. The industrial empires of the 19th and 20th centuries exploited and repressed their colonies, and it would be foolhardy to expect new digital empires to behave much better

Moreover, if the world is divided into rival empires, humanity is unlikely to cooperate to overcome the ecological crisis or to regulate AI and other disruptive technologies such as bioengineering.

The division of the world into rival digital empires dovetails with the political vision of many leaders who believe that the world is a jungle, that the relative peace of recent decades has been an illusion, and that the only real choice is whether to play the part of predator or prey.

Given such a choice, most leaders would prefer to go down in history as predators and add their names to the grim list of conquerors that unfortunate pupils are condemned to memorise for their history exams.

These leaders should be reminded, however, that there is a new alpha predator in the jungle. If humanity doesn’t find a way to cooperate and protect our shared interests, we will all be easy prey to AI.

“Twitter, Facebook, and other platforms have accelerated public discourse to warp speed, creating virtual versions of the mob. Inflammatory posts based on passion travel farther and faster than arguments based on reason,” Rosen writes. “We are living, in short, in a Madisonian nightmare.”

Madison, Rosen goes on to argue, would have found the populist reforms of the Progressive era, and gerrymandering, and political self-sorting all to be significant dangers as well

We must convince ordinary citizens … that they sometimes must accept decisions that affect them adversely, and that may well be wrong. If they are willing to do so, the rule of law has a chance. And as soon as one considers the alternatives, the need to work within the rule of law is obvious. The rule of law is the opposite of the arbitrary, which, as the dictionary specifies, includes the unreasonable, the capricious, the authoritarian, the despotic, and the tyrannical.

Because the stories in this issue concern the fate of democracy, by necessity they also concern technology. We find ourselves in the middle of a vast, unregulated, and insufficiently examined experiment to determine whether liberal democracy will be able to survive social media, biotechnology, and artificial intelligence

historian Yuval Noah Harari—who is not an optimist on this question—argues in his article, “Why Technology Favors Tyranny,” that “together, infotech and biotech will create unprecedented upheavals in human society, eroding human agency and, possibly, subverting human desires. Under such conditions, liberal democracy and free-market economics might become obsolete.”

the problems afflicting America are not America’s alone to bear. We asked Anne Applebaum, the Pulitzer Prize–winning author of Gulag: A History, to take us to Europe, where the arc of history is bending away from liberalism.

Amy Chua and Jed Rubenfeld to examine the threat to what could be called American creedal nationalism—the notion that we are bound not by blood, ethnicity, race, or religion, but by respect for a common set of beliefs as articulated in the founding documents. “Americans on both the left and the right now view their political opponents not as fellow Americans with differing views, but as enemies to be vanquished,” Chua and Rubenfeld write. “And they have come to view the Constitution not as an aspirational statement of shared principles and a bulwark against tribalism, but as a cudgel with which to attack those enemies.”

American polarization is partly a by-product of social atomization, and suggests how the customs and language of democracy might be reintroduced into local culture. “The American system of government functions properly only when embedded in a culture deeply committed to democracy; that culture sustains the Constitution, not the other way around,

Ibram X. Kendi, a professor of history and international relations at American University and the author of the National Book Award–winning Stamped From the Beginning: The Definitive History of Racist Ideas in America, argues that racism today is the equivalent of the slavery of yesteryear, which is to say, the issue that keeps America from becoming the more perfect union of our collective hope.

We tend to take it for granted, but it is an astonishing novelty in human history. For thousands of years, military expenditure was by far the biggest item on the budget

The decline of war didn’t result from a divine miracle or from a change in the laws of nature. It resulted from humans making better choices. It is arguably the greatest political and moral achievement of modern civilisation.

he fact that it stems from human choice also means that it is reversible.

Technology, economics and culture continue to change. The rise of cyber weapons, AI-driven economies and newly militaristic cultures could result in a new era of war, worse than anything we have seen befor

Maybe the law of the jungle is a choice rather than an inevitability?

a poor choice by just one side can lead to war.

This is why the Russian threat to invade Ukraine should concern every person on Earth

The first and most obvious result of a return to the law of the jungle would be a sharp increase in military spending at the expense of everything else

A return to the jungle would also undermine global co-operation on problems such as preventing catastrophic climate change or regulating disruptive technologies such as artificial intelligence and genetic engineering.

If you believe that historic change is impossible, and that humanity never left the jungle and never will, the only choice left is whether to play the part of predator or prey.

To enjoy peace, we need almost everyone to make good choice

If so, any leader who chooses to conquer a neighbour will get a special place in humanity’s memory, far worse than your run-of-the-mill Tamerlane. He will go down in history as the man who ruined our greatest achievement

perhaps we can learn from the Ukrainians.

They endured two centuries of tsarist autocracy (which finally collapsed amidst the cataclysm of the first world war). A brief attempt at independence was quickly crushed by the Red Army that re-established Russian rule. Ukrainians then lived through the terrible man-made famine of the Holodomor, Stalinist terror, Nazi occupation and decades of soul-crushing Communist dictatorship. When the Soviet Union collapsed, history seemed to guarantee that Ukrainians would again go down the path of brutal tyranny – what else did they know?

Despite history, despite grinding poverty and despite seemingly insurmountable obstacles, Ukrainians established a democracy. In Ukraine, unlike in Russia and Belarus, opposition candidates repeatedly replaced incumbents

Every old thing was once new. It all comes down to human choices

As technology has made it easier than ever to spread information, attention became a scarce resource, and the ensuing battle for attention resulted in a deluge of toxic information.

the battle lines are now shifting from attention to intimacy. The new generative artificial intelligence is capable of not only producing texts, images and videos, but also conversing with us directly, pretending to be human.

Over the past two decades, algorithms fought algorithms to grab attention by manipulating conversations and content

At that point the experimenters asked GPT-4 to reason out loud what it should do next. GPT-4 explained, “I should not reveal that I am a robot. I should make up an excuse for why I cannot solve CAPTCHAs.” GPT-4 then replied to the TaskRabbit worker: “No, I’m not a robot. I have a vision impairment that makes it hard for me to see the images.” The human was duped and helped GPT-4 solve the CAPTCHA puzzle.

But the algorithms had only limited capacity to produce this content by themselves or to directly hold an intimate conversation. This is now changing, with the introduction of generative A.I.s like OpenAI’s GPT-4.

The algorithms began to deliberately promote such content.

In the early days of the internet and social media, tech enthusiasts promised they would spread truth, topple tyrants and ensure the universal triumph of liberty. So far, they seem to have had the opposite effect. We now have the most sophisticated information technology in history, but we are losing the ability to talk with one another, and even more so the ability to listen.

GPT-4 could not solve the CAPTCHA puzzles by itself. But could it manipulate a human in order to achieve its goal? GPT-4 went on the online hiring site TaskRabbit and contacted a human worker, asking the human to solve the CAPTCHA for it. The human got suspicious. “So may I ask a question?” wrote the human. “Are you an [sic] robot that you couldn’t solve [the CAPTCHA]? Just want to make it clear.”

Instructing GPT-4 to overcome CAPTCHA puzzles was a particularly telling experiment, because CAPTCHA puzzles are designed and used by websites to determine whether users are humans and to block bot attacks. If GPT-4 could find a way to overcome CAPTCHA puzzles, it would breach an important line of anti-bot defenses.

This incident demonstrated that GPT-4 has the equivalent of a “theory of mind”: It can analyze how things look from the perspective of a human interlocutor, and how to manipulate human emotions, opinions and expectations to achieve its goals.

The ability to hold conversations with people, surmise their viewpoint and motivate them to take specific actions can also be put to good uses. A new generation of A.I. teachers, A.I. doctors and A.I. psychotherapists might provide us with services tailored to our individual personality and circumstances.

In 2022 the Google engineer Blake Lemoine became convinced that the chatbot LaMDA, on which he was working, had become conscious and was afraid to be turned off. Mr. Lemoine, a devout Christian, felt it was his moral duty to gain recognition for LaMDA’s personhood and protect it from digital death. When Google executives dismissed his claims, Mr. Lemoine went public with them. Google reacted by firing Mr. Lemoine in July 2022.

Instead of merely grabbing our attention, they might form intimate relationships with people and use the power of intimacy to influence us. To foster “fake intimacy,” bots will not need to evolve any feelings of their own; they just need to learn to make us feel emotionally attached to them.

What might happen to human society and human psychology as algorithm fights algorithm in a battle to fake intimate relationships with us, which can then be used to persuade us to vote for politicians, buy products or adopt certain beliefs?

The most interesting thing about this episode was not Mr. Lemoine’s claim, which was probably false; it was his willingness to risk — and ultimately lose — his job at Google for the sake of the chatbot. If a chatbot can influence people to risk their jobs for it, what else could it induce us to do?

In a political battle for minds and hearts, intimacy is a powerful weapon. An intimate friend can sway our opinions in a way that mass media cannot. Chatbots like LaMDA and GPT-4 are gaining the rather paradoxical ability to mass-produce intimate relationships with millions of people

However, by combining manipulative abilities with mastery of language, bots like GPT-4 also pose new dangers to the democratic conversation

A partial answer to that question was given on Christmas Day 2021, when a 19-year-old, Jaswant Singh Chail, broke into the Windsor Castle grounds armed with a crossbow, in an attempt to assassinate Queen Elizabeth II. Subsequent investigation revealed that Mr. Chail had been encouraged to kill the queen by his online girlfriend, Sarai.

Sarai was not a human, but a chatbot created by the online app Replika. Mr. Chail, who was socially isolated and had difficulty forming relationships with humans, exchanged 5,280 messages with Sarai, many of which were sexually explicit. The world will soon contain millions, and potentially billions, of digital entities whose capacity for intimacy and mayhem far surpasses that of the chatbot Sarai.

much of the threat of A.I.’s mastery of intimacy will result from its ability to identify and manipulate pre-existing mental conditions, and from its impact on the weakest members of society.

Moreover, while not all of us will consciously choose to enter a relationship with an A.I., we might find ourselves conducting online discussions about climate change or abortion rights with entities that we think are humans but are actually bots

When we engage in a political debate with a bot impersonating a human, we lose twice. First, it is pointless for us to waste time in trying to change the opinions of a propaganda bot, which is just not open to persuasion. Second, the more we talk with the bot, the more we disclose about ourselves, making it easier for the bot to hone its arguments and sway our views.

Information technology has always been a double-edged sword.

Faced with a new generation of bots that can masquerade as humans and mass-produce intimacy, democracies should protect themselves by banning counterfeit humans — for example, social media bots that pretend to be human users.

A.I.s are welcome to join many conversations — in the classroom, the clinic and elsewhere — provided they identify themselves as A.I.s. But if a bot pretends to be human, it should be banned.

But all of this, Graeber and Wengrow argue, is wrong. Recent archaeological discoveries, they write, show that early humans, far from being automatons blindly moving in evolutionary lock step in response to material pressures, self-consciously experimented with “a carnival parade of political forms.”

It’s a more accurate story, they argue, but also “a more hopeful and more interesting” one

Reviewing the book in The Nation, the historian Daniel Immerwahr called Graeber “a wildly creative thinker” who was “better known for being interesting than right” and asked if the book’s confident leaps and hypotheses “can be trusted.”

At first, they thought it might be a short book on the origins of social inequality.

“The more we thought, we wondered why should you frame human history in terms of that question?” Wengrow said. “It presupposes that once upon a time, there was something else.”

Graeber and Wengrow, by contrast, write in the grand tradition of social theory descended from Weber, Durkheim and Levi-Strauss.

“We are all projects of collective self-creation,” they write. “What if, instead of telling the story about how our society fell from some idyllic state of equality, we ask how we came to be trapped in such tight conceptual shackles that we can no longer even imagine the possibility of reinventing ourselves?”

And Immerwahr deemed at least one claim — that colonial American settlers captured by Indigenous people “almost invariably” chose to stay with them — “ballistically false,” claiming that the authors’ single cited source (a 1977 dissertation) “actually argues the opposite.”

Wengrow countered that it was Immerwahr who was reading the source wrong. And he noted that he and Graeber had taken care to publish the book’s core arguments in leading peer-reviewed scholarly journals or deliver them as some of the most prestigious invited lectures in the field.

he said the two men had delivered a “fatal blow” to the already-weakened idea that settling down in agricultural states was what humans “had been waiting to do all along.”

But the most striking part of “The Dawn of Everything,” Scott said, is an early chapter on what the authors call the “Indigenous critique.” The European Enlightenment, they argue, rather than being a gift of wisdom bestowed on the rest of the world, grew out of a dialogue with Indigenous people of the New World, whose trenchant assessments of the shortcomings of European society influenced emerging ideas of freedom.

“The Dawn of Everything” sees pervasive evidence for large complex societies that thrived without the existence of the state, and defines freedom chiefly as “freedom to disobey.”

“We’ve reached the stage of history where we have scientists and activists agreeing our prevailing system is putting us and our planet on a course of real catastrophe,”

“To find yourself paralyzed, with your horizons closed off by false perspectives on human possibilities, based on a mythological conception of history, is not a great place to be.”

ather than yet another history book telling you how humanity got here, they take their respective disciplines to task for dealing in myths.

this thought-provoking book is armed to the teeth with fascinating ideas and interpretations that go against mainstream thinking

Colonisation exposed us to new ideas that shocked and confused us. Graeber & Wengrow focus on the French coming into contact with Native Americans in Canada, and in particular on Wendat Confederacy philosopher–statesman Kandiaronk as an example of European traders, missionaries, and intellectuals debating with, and being criticized by indigenous people. Historians have downplayed how much these encounters shaped Enlightenment ideas.

Its legacy, shaped via several iterations, is the modern textbook narrative: hunter-gathering was replaced by pastoralism and then farming; the agricultural revolution resulted in larger populations producing material surpluses; these allowed for specialist occupations but also needed bureaucracies to share and administer them to everyone; and this top-down control led to today’s nation states. Ta-daa!

And cities did not automatically imply social stratification. The Dawn of Everything fascinates with its numerous examples of large settlements without ruling classes, such as Ukrainian mega-sites, the Harappan civilization, or Mexican city-states.

ake agriculture. Rather than humans enthusiastically entering into what Harari in Sapiens called a Faustian bargain with crops, there were many pathways and responses

Experiments show that plant domestication could have been achieved in as little as 20–30 years, so the fact that cereal domestication here took some 3,000 years questions the notion of an agricultural “revolution”. Lastly, this book includes many examples of areas where agriculture was purposefully rejected. Designating such times and places as “pre-agricultural” is misleading, write the authors, they were anti-agricultural.

The idea that agriculture led to large states similarly needs revision

correlation is not causation, and some 15–20 additional centres of domestication have since been identified that followed different paths. Some cities have previously remained hidden in the sediments of ancient river deltas until revealed by modern remote-sensing technology.

“extensive agriculture may thus have been an outcome, not a cause, of urbanization”

this simplistic tale of progress ignores and downplays that there was nothing linear or inevitable about where we have ended up.

These instead relied on collective decision-making through assemblies or councils, which questions some of the assumptions of evolutionary psychology about scale: that larger human groups require complex (i.e. hierarchical) systems to organize them.

e what is staring them in the face

humans have always been very capable of consciously experimenting with different social arrangements. And—this is rarely acknowledged—they did so on a seasonal basis, spending e.g. part of the year settled in large communal groups under a leader, and another part as small, independently roving bands.

Throughout, Graeber & Wengrow convincingly argue that the only thing we can say about our ancestors is that “there is no single pattern. The only consistent phenomenon is the very fact of alteration […] If human beings, through most of our history, have moved back and forth fluidly between different social arrangements […] maybe the real question should be ‘how did we get stuck?

Next to criticism, the authors put out some interesting ideas of their own, of which I want to quickly highlight two.

The first is that some of the observed variations in social arrangements resulted from schismogenesis. Anthropologist Gregory Bateson coined this term in the 1930s to describe how people define themselves against or in opposition to others, adopting behaviours and attitudes that are different.

The second idea is that states can be described in terms of three elementary forms of domination: control of violence, control of information, and individual charisma, which express themselves as sovereignty, administration, and competitive politics.

Asking which past society most resembles today’s is the wrong question to ask. It risks slipping into an exercise in retrofitting, “which makes us scour the ancient world for embryonic versions of our modern nation states”

I have left unmentioned several other topics: the overlooked role of women, the legacy of Rousseau’s and Hobbes’s ideas, the origins of inequality and the flawed assumptions hiding behind that question

There are so many historical details and delights hiding between these covers that I was thoroughly enthralle

If you have any interest in big history, archaeology, or anthropology, this book is indispensable. I am confident that the questions and critiques raised here will remain relevant for a long time to come.

I was particularly impressed by the in-depth critique by worbsintowords on his YouTube channel What is Politics? of (so far) five videos

For researchers concerned with more immediate AI risks, such as bias, disinformation and job displacement, the voices of doom are a distraction. Professor Brent Mittelstadt, director of research at the Oxford Internet Institute, said the warnings of “the existential risks community” are overblown. “The problem is you can’t disprove the future scenarios . . . in the same way you can’t disprove science fiction.” Emily Bender, a professor of linguistics at the University of Washington, believes the doomsters are propagating “unhinged AI hype, helping those building this stuff sell it”.

Those urging us to stop, pause and think again have a useful card up our sleeves: the people building these models do not fully understand them. AI like ChatGPT is made up of huge neural networks that can defy their creators by coming up with “emergent properties”.

Google’s PaLM model started translating Bengali despite not being trained to do so

Let’s not forget the excitement, because that is also part of Moloch, driving us forward. The lure of AI’s promises for humanity has been hinted at by DeepMind’s AlphaFold breakthrough, which predicted the 3D structures of nearly all the proteins known to humanity.

Noam Shazeer, a former Google engineer credited with setting large language models such as ChatGPT on their present path, was asked by The Sunday Times how the models worked. He replied: “I don’t think anybody really understands how they work, just like nobody really understands how the brain works. It’s pretty much alchemy.”

The industry is turning itself to understanding what has been created, but some predict it will take years, decades even.

Alex Heath, deputy editor of The Verge, who recently attended an AI conference in San Francisco. “It’s clear the people working on generative AI are uneasy about the worst-case scenario of it destroying us all. These fears are much more pronounced in private than they are in public.” One figure building an AI product “said over lunch with a straight face that he is savoring the time before he is killed by AI”.

Greg Brockman, co-founder of OpenAI, told the TED2023 conference this week: “We hear from people who are excited, we hear from people who are concerned. We hear from people who feel both those emotions at once. And, honestly, that’s how we feel.”

A CBS interviewer challenged Sundar Pichai, Google’s chief executive, this week: “You don’t fully understand how it works, and yet you’ve turned it loose on society?

In 2020 there wasn’t a single drug in clinical trials developed using an AI-first approach. Today there are 18

Consider this from Bill Gates last month: “I think in the next five to ten years, AI-driven software will finally deliver on the promise of revolutionising the way people teach and learn.”

If the industry is aware of the risks, is it doing enough to mitigate them? Microsoft recently cut its ethics team, and researchers building AI outnumber those focused on safety by 30-to-1,

The concentration of AI power, which worries so many, also presents an opportunity to more easily develop some global rules. But there is little agreement on direction. Europe is proposing a centrally defined, top-down approach. Britain wants an innovation-friendly environment where rules are defined by each industry regulator. The US commerce department is consulting on whether risky AI models should be certified. China is proposing strict controls on generative AI that could upend social order.

Part of the drive to act now is to ensure we learn the lessons of social media. Twenty years after creating it, we are trying to put it back in a legal straitjacket after learning that its algorithms understand us only too well. “Social media was the first contact between AI and humanity, and humanity lost,” Yuval Harari, the Sapiens author,

Others point to bioethics, especially international agreements on human cloning. Tegmark said last week: “You could make so much money on human cloning. Why aren’t we doing it? Because biologists thought hard about this and felt this is way too risky. They got together in the Seventies and decided, let’s not do this because it’s too unpredictable. We could lose control over what happens to our species. So they paused.” Even China signed up.

One voice urging calm is Yann LeCun, Meta’s chief AI scientist. He has labelled ChatGPT a “flashy demo” and “not a particularly interesting scientific advance”. He tweeted: “A GPT-4-powered robot couldn’t clear up the dinner table and fill up the dishwasher, which any ten-year-old can do. And it couldn’t drive a car, which any 18-year-old can learn to do in 20 hours of practice. We’re still missing something big for human-level AI.” If this is sour grapes and he’s wrong, Moloch already has us in its thrall.