Group items tagged

the stage was set for the major transformation, which began in 2009: the intensification of viral dynamics.

Before 2009, Facebook had given users a simple timeline––a never-ending stream of content generated by their friends and connections, with the newest posts at the top and the oldest ones at the bottom

That began to change in 2009, when Facebook offered users a way to publicly “like” posts with the click of a button. That same year, Twitter introduced something even more powerful: the “Retweet” button, which allowed users to publicly endorse a post while also sharing it with all of their followers.

“Like” and “Share” buttons quickly became standard features of most other platforms.

Facebook developed algorithms to bring each user the content most likely to generate a “like” or some other interaction, eventually including the “share” as well.

Later research showed that posts that trigger emotions––especially anger at out-groups––are the most likely to be shared.

By 2013, social media had become a new game, with dynamics unlike those in 2008. If you were skillful or lucky, you might create a post that would “go viral” and make you “internet famous”

If you blundered, you could find yourself buried in hateful comments. Your posts rode to fame or ignominy based on the clicks of thousands of strangers, and you in turn contributed thousands of clicks to the game.

This new game encouraged dishonesty and mob dynamics: Users were guided not just by their true preferences but by their past experiences of reward and punishment,

As a social psychologist who studies emotion, morality, and politics, I saw this happening too. The newly tweaked platforms were almost perfectly designed to bring out our most moralistic and least reflective selves. The volume of outrage was shocking.

It was just this kind of twitchy and explosive spread of anger that James Madison had tried to protect us from as he was drafting the U.S. Constitution.

The Framers of the Constitution were excellent social psychologists. They knew that democracy had an Achilles’ heel because it depended on the collective judgment of the people, and democratic communities are subject to “the turbulency and weakness of unruly passions.”

The key to designing a sustainable republic, therefore, was to build in mechanisms to slow things down, cool passions, require compromise, and give leaders some insulation from the mania of the moment while still holding them accountable to the people periodically, on Election Day.

The tech companies that enhanced virality from 2009 to 2012 brought us deep into Madison’s nightmare.

a less quoted yet equally important insight, about democracy’s vulnerability to triviality.

Madison notes that people are so prone to factionalism that “where no substantial occasion presents itself, the most frivolous and fanciful distinctions have been sufficient to kindle their unfriendly passions and excite their most violent conflicts.”

Social media has both magnified and weaponized the frivolous.

It’s not just the waste of time and scarce attention that matters; it’s the continual chipping-away of trust.

a democracy depends on widely internalized acceptance of the legitimacy of rules, norms, and institutions.

when citizens lose trust in elected leaders, health authorities, the courts, the police, universities, and the integrity of elections, then every decision becomes contested; every election becomes a life-and-death struggle to save the country from the other side

The most recent Edelman Trust Barometer (an international measure of citizens’ trust in government, business, media, and nongovernmental organizations) showed stable and competent autocracies (China and the United Arab Emirates) at the top of the list, while contentious democracies such as the United States, the United Kingdom, Spain, and South Korea scored near the bottom (albeit above Russia).

The literature is complex—some studies show benefits, particularly in less developed democracies—but the review found that, on balance, social media amplifies political polarization; foments populism, especially right-wing populism; and is associated with the spread of misinformation.

When people lose trust in institutions, they lose trust in the stories told by those institutions. That’s particularly true of the institutions entrusted with the education of children.

Facebook and Twitter make it possible for parents to become outraged every day over a new snippet from their children’s history lessons––and math lessons and literature selections, and any new pedagogical shifts anywhere in the country

The motives of teachers and administrators come into question, and overreaching laws or curricular reforms sometimes follow, dumbing down education and reducing trust in it further.

young people educated in the post-Babel era are less likely to arrive at a coherent story of who we are as a people, and less likely to share any such story with those who attended different schools or who were educated in a different decade.

former CIA analyst Martin Gurri predicted these fracturing effects in his 2014 book, The Revolt of the Public. Gurri’s analysis focused on the authority-subverting effects of information’s exponential growth, beginning with the internet in the 1990s. Writing nearly a decade ago, Gurri could already see the power of social media as a universal solvent, breaking down bonds and weakening institutions everywhere it reached.

he notes a constructive feature of the pre-digital era: a single “mass audience,” all consuming the same content, as if they were all looking into the same gigantic mirror at the reflection of their own society. I

The digital revolution has shattered that mirror, and now the public inhabits those broken pieces of glass. So the public isn’t one thing; it’s highly fragmented, and it’s basically mutually hostile

Facebook, Twitter, YouTube, and a few other large platforms unwittingly dissolved the mortar of trust, belief in institutions, and shared stories that had held a large and diverse secular democracy together.

I think we can date the fall of the tower to the years between 2011 (Gurri’s focal year of “nihilistic” protests) and 2015, a year marked by the “great awokening” on the left and the ascendancy of Donald Trump on the right.

Twitter can overpower all the newspapers in the country, and stories cannot be shared (or at least trusted) across more than a few adjacent fragments—so truth cannot achieve widespread adherence.

fter Babel, nothing really means anything anymore––at least not in a way that is durable and on which people widely agree.

Politics After Babel

“Politics is the art of the possible,” the German statesman Otto von Bismarck said in 1867. In a post-Babel democracy, not much may be possible.

The ideological distance between the two parties began increasing faster in the 1990s. Fox News and the 1994 “Republican Revolution” converted the GOP into a more combative party.

So cross-party relationships were already strained before 2009. But the enhanced virality of social media thereafter made it more hazardous to be seen fraternizing with the enemy or even failing to attack the enemy with sufficient vigor.

What changed in the 2010s? Let’s revisit that Twitter engineer’s metaphor of handing a loaded gun to a 4-year-old. A mean tweet doesn’t kill anyone; it is an attempt to shame or punish someone publicly while broadcasting one’s own virtue, brilliance, or tribal loyalties. It’s more a dart than a bullet

from 2009 to 2012, Facebook and Twitter passed out roughly 1 billion dart guns globally. We’ve been shooting one another ever since.

“devoted conservatives,” comprised 6 percent of the U.S. population.

the warped “accountability” of social media has also brought injustice—and political dysfunction—in three ways.

First, the dart guns of social media give more power to trolls and provocateurs while silencing good citizens.

a small subset of people on social-media platforms are highly concerned with gaining status and are willing to use aggression to do so.

Across eight studies, Bor and Petersen found that being online did not make most people more aggressive or hostile; rather, it allowed a small number of aggressive people to attack a much larger set of victims. Even a small number of jerks were able to dominate discussion forums,

Additional research finds that women and Black people are harassed disproportionately, so the digital public square is less welcoming to their voices.

Second, the dart guns of social media give more power and voice to the political extremes while reducing the power and voice of the moderate majority.

The “Hidden Tribes” study, by the pro-democracy group More in Common, surveyed 8,000 Americans in 2017 and 2018 and identified seven groups that shared beliefs and behaviors.

Social media has given voice to some people who had little previously, and it has made it easier to hold powerful people accountable for their misdeeds

The group furthest to the left, the “progressive activists,” comprised 8 percent of the population. The progressive activists were by far the most prolific group on social media: 70 percent had shared political content over the previous year. The devoted conservatives followed, at 56 percent.

These two extreme groups are similar in surprising ways. They are the whitest and richest of the seven groups, which suggests that America is being torn apart by a battle between two subsets of the elite who are not representative of the broader society.

they are the two groups that show the greatest homogeneity in their moral and political attitudes.

likely a result of thought-policing on social media:

political extremists don’t just shoot darts at their enemies; they spend a lot of their ammunition targeting dissenters or nuanced thinkers on their own team.

Finally, by giving everyone a dart gun, social media deputizes everyone to administer justice with no due process. Platforms like Twitter devolve into the Wild West, with no accountability for vigilantes.

Enhanced-virality platforms thereby facilitate massive collective punishment for small or imagined offenses, with real-world consequences, including innocent people losing their jobs and being shamed into suicide

we don’t get justice and inclusion; we get a society that ignores context, proportionality, mercy, and truth.

Since the tower fell, debates of all kinds have grown more and more confused. The most pervasive obstacle to good thinking is confirmation bias, which refers to the human tendency to search only for evidence that confirms our preferred beliefs

search engines were supercharging confirmation bias, making it far easier for people to find evidence for absurd beliefs and conspiracy theorie

The most reliable cure for confirmation bias is interaction with people who don’t share your beliefs. They confront you with counterevidence and counterargument.

In his book The Constitution of Knowledge, Jonathan Rauch describes the historical breakthrough in which Western societies developed an “epistemic operating system”—that is, a set of institutions for generating knowledge from the interactions of biased and cognitively flawed individuals

English law developed the adversarial system so that biased advocates could present both sides of a case to an impartial jury.

Newspapers full of lies evolved into professional journalistic enterprises, with norms that required seeking out multiple sides of a story, followed by editorial review, followed by fact-checking.

Universities evolved from cloistered medieval institutions into research powerhouses, creating a structure in which scholars put forth evidence-backed claims with the knowledge that other scholars around the world would be motivated to gain prestige by finding contrary evidence.

Part of America’s greatness in the 20th century came from having developed the most capable, vibrant, and productive network of knowledge-producing institutions in all of human history

But this arrangement, Rauch notes, “is not self-maintaining; it relies on an array of sometimes delicate social settings and understandings, and those need to be understood, affirmed, and protected.”

This, I believe, is what happened to many of America’s key institutions in the mid-to-late 2010s. They got stupider en masse because social media instilled in their members a chronic fear of getting darted

it was so pervasive that it established new behavioral norms backed by new policies seemingly overnight

Participants in our key institutions began self-censoring to an unhealthy degree, holding back critiques of policies and ideas—even those presented in class by their students—that they believed to be ill-supported or wrong.

The stupefying process plays out differently on the right and the left because their activist wings subscribe to different narratives with different sacred values.

The “Hidden Tribes” study tells us that the “devoted conservatives” score highest on beliefs related to authoritarianism. They share a narrative in which America is eternally under threat from enemies outside and subversives within; they see life as a battle between patriots and traitors.

they are psychologically different from the larger group of “traditional conservatives” (19 percent of the population), who emphasize order, decorum, and slow rather than radical change.

The traditional punishment for treason is death, hence the battle cry on January 6: “Hang Mike Pence.”

Right-wing death threats, many delivered by anonymous accounts, are proving effective in cowing traditional conservatives

The wave of threats delivered to dissenting Republican members of Congress has similarly pushed many of the remaining moderates to quit or go silent, giving us a party ever more divorced from the conservative tradition, constitutional responsibility, and reality.

The stupidity on the right is most visible in the many conspiracy theories spreading across right-wing media and now into Congress.

The Democrats have also been hit hard by structural stupidity, though in a different way. In the Democratic Party, the struggle between the progressive wing and the more moderate factions is open and ongoing, and often the moderates win.

The problem is that the left controls the commanding heights of the culture: universities, news organizations, Hollywood, art museums, advertising, much of Silicon Valley, and the teachers’ unions and teaching colleges that shape K–12 education. And in many of those institutions, dissent has been stifled:

Liberals in the late 20th century shared a belief that the sociologist Christian Smith called the “liberal progress” narrative, in which America used to be horrifically unjust and repressive, but, thanks to the struggles of activists and heroes, has made (and continues to make) progress toward realizing the noble promise of its founding.

It is also the view of the “traditional liberals” in the “Hidden Tribes” study (11 percent of the population), who have strong humanitarian values, are older than average, and are largely the people leading America’s cultural and intellectual institutions.

when the newly viralized social-media platforms gave everyone a dart gun, it was younger progressive activists who did the most shooting, and they aimed a disproportionate number of their darts at these older liberal leaders.

Confused and fearful, the leaders rarely challenged the activists or their nonliberal narrative in which life at every institution is an eternal battle among identity groups over a zero-sum pie, and the people on top got there by oppressing the people on the bottom. This new narrative is rigidly egalitarian––focused on equality of outcomes, not of rights or opportunities. It is unconcerned with individual rights.

The universal charge against people who disagree with this narrative is not “traitor”; it is “racist,” “transphobe,” “Karen,” or some related scarlet letter marking the perpetrator as one who hates or harms a marginalized group.

The punishment that feels right for such crimes is not execution; it is public shaming and social death.

anyone on Twitter had already seen dozens of examples teaching the basic lesson: Don’t question your own side’s beliefs, policies, or actions. And when traditional liberals go silent, as so many did in the summer of 2020, the progressive activists’ more radical narrative takes over as the governing narrative of an organization.

This is why so many epistemic institutions seemed to “go woke” in rapid succession that year and the next, beginning with a wave of controversies and resignations at The New York Times and other newspapers, and continuing on to social-justice pronouncements by groups of doctors and medical associations

The problem is structural. Thanks to enhanced-virality social media, dissent is punished within many of our institutions, which means that bad ideas get elevated into official policy.

In a 2018 interview, Steve Bannon, the former adviser to Donald Trump, said that the way to deal with the media is “to flood the zone with shit.” He was describing the “firehose of falsehood” tactic pioneered by Russian disinformation programs to keep Americans confused, disoriented, and angry.

artificial intelligence is close to enabling the limitless spread of highly believable disinformation. The AI program GPT-3 is already so good that you can give it a topic and a tone and it will spit out as many essays as you like, typically with perfect grammar and a surprising level of coherence.

Renée DiResta, the research manager at the Stanford Internet Observatory, explained that spreading falsehoods—whether through text, images, or deep-fake videos—will quickly become inconceivably easy. (She co-wrote the essay with GPT-3.)

American factions won’t be the only ones using AI and social media to generate attack content; our adversaries will too.

In the 20th century, America’s shared identity as the country leading the fight to make the world safe for democracy was a strong force that helped keep the culture and the polity together.

In the 21st century, America’s tech companies have rewired the world and created products that now appear to be corrosive to democracy, obstacles to shared understanding, and destroyers of the modern tower.

What changes are needed?

I can suggest three categories of reforms––three goals that must be achieved if democracy is to remain viable in the post-Babel era.

We must harden democratic institutions so that they can withstand chronic anger and mistrust, reform social media so that it becomes less socially corrosive, and better prepare the next generation for democratic citizenship in this new age.

Harden Democratic Institutions

we must reform key institutions so that they can continue to function even if levels of anger, misinformation, and violence increase far above those we have today.

Reforms should reduce the outsize influence of angry extremists and make legislators more responsive to the average voter in their district.

One example of such a reform is to end closed party primaries, replacing them with a single, nonpartisan, open primary from which the top several candidates advance to a general election that also uses ranked-choice voting

A second way to harden democratic institutions is to reduce the power of either political party to game the system in its favor, for example by drawing its preferred electoral districts or selecting the officials who will supervise elections

These jobs should all be done in a nonpartisan way.

Reform Social Media

Social media’s empowerment of the far left, the far right, domestic trolls, and foreign agents is creating a system that looks less like democracy and more like rule by the most aggressive.

it is within our power to reduce social media’s ability to dissolve trust and foment structural stupidity. Reforms should limit the platforms’ amplification of the aggressive fringes while giving more voice to what More in Common calls “the exhausted majority.”

the main problem with social media is not that some people post fake or toxic stuff; it’s that fake and outrage-inducing content can now attain a level of reach and influence that was not possible before

Perhaps the biggest single change that would reduce the toxicity of existing platforms would be user verification as a precondition for gaining the algorithmic amplification that social media offers.

One of the first orders of business should be compelling the platforms to share their data and their algorithms with academic researchers.

Prepare the Next Generation

Childhood has become more tightly circumscribed in recent generations––with less opportunity for free, unstructured play; less unsupervised time outside; more time online. Whatever else the effects of these shifts, they have likely impeded the development of abilities needed for effective self-governance for many young adults

Depression makes people less likely to want to engage with new people, ideas, and experiences. Anxiety makes new things seem more threatening. As these conditions have risen and as the lessons on nuanced social behavior learned through free play have been delayed, tolerance for diverse viewpoints and the ability to work out disputes have diminished among many young people

Students did not just say that they disagreed with visiting speakers; some said that those lectures would be dangerous, emotionally devastating, a form of violence. Because rates of teen depression and anxiety have continued to rise into the 2020s, we should expect these views to continue in the generations to follow, and indeed to become more severe.

The most important change we can make to reduce the damaging effects of social media on children is to delay entry until they have passed through puberty.

The age should be raised to at least 16, and companies should be held responsible for enforcing it.

et them out to play. Stop starving children of the experiences they most need to become good citizens: free play in mixed-age groups of children with minimal adult supervision

while social media has eroded the art of association throughout society, it may be leaving its deepest and most enduring marks on adolescents. A surge in rates of anxiety, depression, and self-harm among American teens began suddenly in the early 2010s. (The same thing happened to Canadian and British teens, at the same time.) The cause is not known, but the timing points to social media as a substantial contributor—the surge began just as the large majority of American teens became daily users of the major platforms.

What would it be like to live in Babel in the days after its destruction? We know. It is a time of confusion and loss. But it is also a time to reflect, listen, and build.

In recent years, Americans have started hundreds of groups and organizations dedicated to building trust and friendship across the political divide, including BridgeUSA, Braver Angels (on whose board I serve), and many others listed at BridgeAlliance.us. We cannot expect Congress and the tech companies to save us. We must change ourselves and our communities.

when we look away from our dysfunctional federal government, disconnect from social media, and talk with our neighbors directly, things seem more hopeful. Most Americans in the More in Common report are members of the “exhausted majority,” which is tired of the fighting and is willing to listen to the other side and compromise. Most Americans now see that social media is having a negative impact on the country, and are becoming more aware of its damaging effects on children.

Above all, the manual emphasized efficiency. Managers were told to answer DMs in less than five minutes, since users were coming to OnlyFans for immediate gratification and would go elsewhere if ignored. It encouraged the creation of keyboard shortcuts, so that managers could deploy an arsenal of rote sexual phrases with a few keystrokes, steering conversations toward the hard sell. It also outlined a series of strategies to boost engagement on the pages, including a gambit in which models would offer to rate a picture of a subscriber’s penis for a fee.

“Every page needs to have an established back story to make the person seem more believable,” it stated. OnlyFans works because people pay for a connection that feels deeper than porn. The document encouraged Ekko’s employees, called page managers, to identify “big spenders” who would part ways with more than $200 in short order, and cultivate a deep rapport by asking about their life and what they do for a living.

This can be extremely time-consuming: In an interview with this magazine last year, an OnlyFans creator said she spends six hours a day just sexting with subscribers. But these relationships are important to cultivate. In a blog post on its website, OnlyFans encourages creators to cater to their “superfans,” who pay for custom content and will “give more if they feel they’re getting something special.”

But all of them take advantage of the same raw materials: the endless reproducibility of digital images; the widespread global availability of cheap English-speaking labor; and the world’s unquenchable desire for companionship.

The key to this business model is the ready availability of cheap English-speaking labor around the globe. Job postings for OnlyFans chatters are widespread on freelance sites like Upwork, many offering as little as $3 an hour. Agency heads told me they’ve hired workers from Eastern Europe, Africa and all across Southeast Asia. “At the end of the day, it is a geo-arbitrage business,”

This phenomenon is part of a broader boom in homespun online businesses that connect cheap developing-world labor with American consumers, allowing the proprietor to step back and reap the profits

During his stint as a chatter, Andre has become intimately familiar with the quirks and desires of the subscribers. Over time, he’s learned something of a sex-work cliché: More than sexual gratification, he said, many of the guys just want someone to talk to

In the days following the disappearance of the columnist Jamal Khashoggi, Arabic-language social media erupted in support for Crown Prince Mohammed bin Salman, who was widely rumored to have ordered his murder. On a single day in October, the phrase “we all have trust in Mohammed bin Salman” featured in 250,000 tweets. “We have to stand by our leader” was posted more than 60,000 times, along with 100,000 messages imploring Saudis to “Unfollow enemies of the nation.” In all likelihood, the majority of these messages were generated by chatbots.

around a fifth of all tweets discussing the 2016 presidential election are believed to have been the work of chatbots.

a third of all traffic on Twitter before the 2016 referendum on Britain’s membership in the European Union was said to come from chatbots, principally in support of the Leave side.

It’s irrelevant that current bots are not “smart” like we are, or that they have not achieved the consciousness and creativity hoped for by A.I. purists. What matters is their impact

In the past, despite our differences, we could at least take for granted that all participants in the political process were human beings. This no longer true

Increasingly we share the online debate chamber with nonhuman entities that are rapidly growing more advanced

a bot developed by the British firm Babylon reportedly achieved a score of 81 percent in the clinical examination for admission to the Royal College of General Practitioners. The average score for human doctors? 72 percent.

If chatbots are approaching the stage where they can answer diagnostic questions as well or better than human doctors, then it’s possible they might eventually reach or surpass our levels of political sophistication

chatbots could seriously endanger our democracy, and not just when they go haywire.

They’ll likely have faces and voices, names and personalities — all engineered for maximum persuasion. So-called “deep fake” videos can already convincingly synthesize the speech and appearance of real politicians.

The most obvious risk is that we are crowded out of our own deliberative processes by systems that are too fast and too ubiquitous for us to keep up with.

A related risk is that wealthy people will be able to afford the best chatbots.

in a world where, increasingly, the only feasible way of engaging in debate with chatbots is through the deployment of other chatbots also possessed of the same speed and facility, the worry is that in the long run we’ll become effectively excluded from our own party.

the wholesale automation of deliberation would be an unfortunate development in democratic history.

A blunt approach — call it disqualification — would be an all-out prohibition of bots on forums where important political speech takes place, and punishment for the humans responsible

The Bot Disclosure and Accountability Bil

would amend the Federal Election Campaign Act of 1971 to prohibit candidates and political parties from using any bots intended to impersonate or replicate human activity for public communication. It would also stop PACs, corporations and labor organizations from using bots to disseminate messages advocating candidates, which would be considered “electioneering communications.”

A subtler method would involve mandatory identification: requiring all chatbots to be publicly registered and to state at all times the fact that they are chatbots, and the identity of their human owners and controllers.

We should also be exploring more imaginative forms of regulation. Why not introduce a rule, coded into platforms themselves, that bots may make only up to a specific number of online contributions per day, or a specific number of responses to a particular human?

We need not treat the speech of chatbots with the same reverence that we treat human speech. Moreover, bots are too fast and tricky to be subject to ordinary rules of debate

the methods we use to regulate bots must be more robust than those we apply to people. There can be no half-measures when democracy is at stake.

The volatility of chatbots has made it impossible to predict their impact. In one second, the systems impress by fielding a complex request for a five-day itinerary, making Google’s search engine look archaic. A moment later, they disturb by taking conversations in dark directions and launching verbal assaults.

The result is an industry gripped with the question: What do we do now?

The A.I. systems could disrupt $100 billion in cloud spending, $500 billion in digital advertising and $5.4 trillion in e-commerce sales,

As Microsoft figures out a chatbot business model, it is forging ahead with plans to sell the technology to others. It charges $10 a month for a cloud service, built in conjunction with the OpenAI lab, that provides developers with coding suggestions, among other things.

Smaller companies like Box need help building chatbot tools, so they are turning to the giants that process, store and manage information across the web. Those companies — Google, Microsoft and Amazon — are in a race to provide businesses with the software and substantial computing power behind their A.I. chatbots.

“The cloud computing providers have gone all in on A.I. over the last few months,

“They are realizing that in a few years, most of the spending will be on A.I., so it is important for them to make big bets.”

Yusuf Mehdi, the head of Bing, said the company was wrestling with how the new version would make money. Advertising will be a major driver, he said, but the company expects fewer ads than traditional search allows.

Google, perhaps more than any other company, has reason to both love and hate the chatbots. It has declared a “code red” because their abilities could be a blow to its $162 billion business showing ads on searches.

“The discourse on A.I. is rather narrow and focused on text and the chat experience,” Mr. Taylor said. “Our vision for search is about understanding information and all its forms: language, images, video, navigating the real world.”

Sridhar Ramaswamy, who led Google’s advertising division from 2013 to 2018, said Microsoft and Google recognized that their current search business might not survive. “The wall of ads and sea of blue links is a thing of the past,” said Mr. Ramaswamy, who now runs Neeva, a subscription-based search engine.

As that underlying tech, known as generative A.I., becomes more widely available, it could fuel new ideas in e-commerce. Late last year, Manish Chandra, the chief executive of Poshmark, a popular online secondhand store, found himself daydreaming during a long flight from India about chatbots building profiles of people’s tastes, then recommending and buying clothes or electronics. He imagined grocers instantly fulfilling orders for a recipe.

“It becomes your mini-Amazon,” said Mr. Chandra, who has made integrating generative A.I. into Poshmark one of the company’s top priorities over the next three years. “That layer is going to be very powerful and disruptive and start almost a new layer of retail.”

In early December, users of Stack Overflow, a popular social network for computer programmers, began posting substandard coding advice written by ChatGPT. Moderators quickly banned A.I.-generated text

t people could post this questionable content far faster than they could write posts on their own, said Dennis Soemers, a moderator for the site. “Content generated by ChatGPT looks trustworthy and professional, but often isn’t,”

When websites thrived during the pandemic as traffic from Google surged, Nilay Patel, editor in chief of The Verge, a tech news site, warned publishers that the search giant would one day turn off the spigot. He had seen Facebook stop linking out to websites and foresaw Google following suit in a bid to boost its own business.

He predicted that visitors from Google would drop from a third of websites’ traffic to nothing. He called that day “Google zero.”

Because chatbots replace website search links with footnotes to answers, he said, many publishers are now asking if his prophecy is coming true.

, strategists and engineers at the digital advertising company CafeMedia have met twice a week to contemplate a future where A.I. chatbots replace search engines and squeeze web traffic.

The group recently discussed what websites should do if chatbots lift information but send fewer visitors. One possible solution would be to encourage CafeMedia’s network of 4,200 websites to insert code that limited A.I. companies from taking content, a practice currently allowed because it contributes to search rankings.

Courts are expected to be the ultimate arbiter of content ownership. Last month, Getty Images sued Stability AI, the start-up behind the art generator tool Stable Diffusion, accusing it of unlawfully copying millions of images. The Wall Street Journal has said using its articles to train an A.I. system requires a license.

In the meantime, A.I. companies continue collecting information across the web under the “fair use” doctrine, which permits limited use of material without permission.

hose promises have also fueled anxiety over how people will be able to compete for jobs outsourced to eerily refined machines or trust the accuracy of what they see online.

Officials with the San Francisco lab said GPT-4’s “multimodal” training across text and images would allow it to escape the chat box and more fully emulate a world of color and imagery, surpassing ChatGPT in its “advanced reasoning capabilities.”

A person could upload an image and GPT-4 could caption it for them, describing the objects and scene.

AI language models often confidently offer wrong answers because they are designed to spit out cogent phrases, not actual facts. And because they have been trained on internet text and imagery, they have also learned to emulate human biases of race, gender, religion and class.

GPT-4 still makes many of the errors of previous versions, including “hallucinating” nonsense, perpetuating social biases and offering bad advice. It also lacks knowledge of events that happened after about September 2021, when its training data was finalized, and “does not learn from its experience,” limiting people’s ability to teach it new things.

Microsoft has invested billions of dollars in OpenAI in the hope its technology will become a secret weapon for its workplace software, search engine and other online ambitions. It has marketed the technology as a super-efficient companion that can handle mindless work and free people for creative pursuits, helping one software developer to do the work of an entire team or allowing a mom-and-pop shop to design a professional advertising campaign without outside help.

it could lead to business models and creative ventures no one can predict.

sparked criticism that the companies are rushing to exploit an untested, unregulated and unpredictable technology that could deceive people, undermine artists’ work and lead to real-world harm.

the company held back the feature to better understand potential risks. As one example, she said, the model might be able to look at an image of a big group of people and offer up known information about them, including their identities — a possible facial recognition use case that could be used for mass surveillance.

OpenAI researchers wrote, “As GPT-4 and AI systems like it are adopted more widely,” they “will have even greater potential to reinforce entire ideologies, worldviews, truths and untruths, and to cement them or lock them in.”

“We can agree as a society broadly on some harms that a model should not contribute to,” such as building a nuclear bomb or generating child sexual abuse material, she said. “But many harms are nuanced and primarily affect marginalized groups,” she added, and those harmful biases, especially across other languages, “cannot be a secondary consideration in performance.”

OpenAI said its new model would be able to handle more than 25,000 words of text, a leap forward that could facilitate longer conversations and allow for the searching and analysis of long documents.

OpenAI developers said GPT-4 was more likely to provide factual responses and less likely to refuse harmless requests

Duolingo, the language learning app, has already used GPT-4 to introduce new features, such as an AI conversation partner and a tool that tells users why an answer was incorrect.

The company did not share evaluations around bias that have become increasingly common after pressure from AI ethicists.

GPT-4 will have competition in the growing field of multisensory AI. DeepMind, an AI firm owned by Google’s parent company Alphabet, last year released a “generalist” model named Gato that can describe images and play video games. And Google this month released a multimodal system, PaLM-E, that folded AI vision and language expertise into a one-armed robot on wheels: If someone told it to go fetch some chips, for instance, it could comprehend the request, wheel over to a drawer and choose the right bag.

The systems, though — as critics and the AI researchers are quick to point out — are merely repeating patterns and associations found in their training data without a clear understanding of what it’s saying or when it’s wrong.

GPT-4, the fourth “generative pre-trained transformer” since OpenAI’s first release in 2018, relies on a breakthrough neural-network technique in 2017 known as the transformer that rapidly advanced how AI systems can analyze patterns in human speech and imagery.

The systems are “pre-trained” by analyzing trillions of words and images taken from across the internet: news articles, restaurant reviews and message-board arguments; memes, family photos and works of art.

Giant supercomputer clusters of graphics processing chips are mapped out their statistical patterns — learning which words tended to follow each other in phrases, for instance — so that the AI can mimic those patterns, automatically crafting long passages of text or detailed images, one word or pixel at a time.

In 2019, the company refused to publicly release GPT-2, saying it was so good they were concerned about the “malicious applications” of its use, from automated spam avalanches to mass impersonation and disinformation campaigns.

Altman has also marketed OpenAI’s vision with the aura of science fiction come to life. In a blog post last month, he said the company was planning for ways to ensure that “all of humanity” benefits from “artificial general intelligence,” or AGI — an industry term for the still-fantastical idea of an AI superintelligence that is generally as smart as, or smarter than, the humans themselves.

Before the introduction of Botox and hyaluronic acid dermal fillers in 2002 and 2003, respectively, aesthetic work was serious, expensive. Nose jobs and face lifts required general anesthesia, not insignificant recovery time, and cost thousands of dollars (in 2000, a facelift was $5,416 on average, and a rhinoplasty $4,109, around $9,400 and $7,000 adjusted).

In contrast, the average price of a syringe of hyaluronic acid filler today is $684, while treating, for example, the forehead and eyes with Botox will put you out anywhere from $300 to $600

We copied the beautiful and the rich, not in facsimile, but in homage.

In 2018, use of Botox and fillers was up 18% and 20% from five years prior. Philosophies of prejuvenation have made Botox use jump 22% among 22- to 37-year-olds in half a decade as well. By 2030, global noninvasive aesthetic treatments are predicted to triple.

The trouble is that a status symbol, without status, is common.

Beauty has always been exclusive. When someone strikes you as pretty, it means they are something that everyone else is not.

It’s a zero-sum game, as relative as our morals. Naturally, we hoard of beauty what we can. It’s why we call grooming tips “secrets.”

Largely the secrets started with the wealthy, who possess the requisite money and leisure to spare on their appearances

Botox and filler only accelerated a trend that began in the ’70s and ’80s and is just now reaching its saturation point.

we didn’t have the tools for anything more than emulation. Fake breasts and overdrawn lips only approximated real ones; a birthmark drawn with pencil would always be just that.

Instagram Face, on the other hand, distinguishes itself by its sheer reproducibility. Not only because of those new cosmetic technologies, which can truly reshape features, at reasonable cost and with little risk.

built in to the whole premise of reversible, low-stakes modification is an indefinite flux, and thus a lack of discretion.

Instagram Face has replicated outward, with trendsetters giving up competing with one another in favor of looking eerily alike. And obviously it has replicated down.

Eva looks like Eva. If she has procedures in common with Kim K, you couldn’t tell. “I look at my features and I think long and hard of how I can, without looking different and while keeping as natural as possible, make them look better and more proportional. I’m against everything that is too invasive. My problem with Instagram Face is that if you want to look like someone else, you should be in therapy.”

natural looks have always been, and still are, more valuable than artificial ones. Partly because of our urge to legitimize in any way we can the advantages we have over other people. Hotness is a class struggle.

As more and more women post videos of themselves eating, sleeping, dressing, dancing, and Only-Fanning online, in a logical bid for economic ascendance, the women who haven’t needed to do that gain a new status symbol.

Privacy. A life which is not a ticketed show. An intimacy that does not admit advertisers. A face that does not broadcast its insecurity, or the work undergone to correct it.

Upper class, private women get discrete work done. The differences aren’t in the procedures themselves—they’re the same—but in disposition

Eva, who lives between central London, Geneva, and the south of France, says: “I do stuff, but none of the stuff I do is at all in my head associated with Instagram Face. Essentially you do similar procedures, but the end goal is completely different. Because they are trying to get the result of looking like another human being, and I’m just beautifying myself.”

But the more rapidly it replicates, and the clearer our manuals for quick imitation become, the closer we get to singularity—that moment Kim Kardashian fears unlike any other: the moment when it becomes unclear whether we’re copying her, or whether she is copying us.

what he restores is complicated and yet not complicated at all. It’s herself, the fingerprint of her features. Her aura, her presence and genealogy, her authenticity in space and time.

Dr. Taktouk’s approach is “not so formulaic.” He aims to give his patients the “better versions of themselves.” “It’s not about trying to be anyone else,” he says, “or creating a conveyor belt of patients. It’s about working with your best features, enhancing them, but still looking like you.”

“Vulgar” says that in pursuing indistinguishability, women have been duped into another punishing divide. “Vulgar” says that the subtlety of his work is what signals its special class—and that the women who’ve obtained Instagram Face for mobility’s sake have unwittingly shut themselves out of it.

While younger women are dissolving their gratuitous work, the 64-year-old Madonna appeared at the Grammy Awards in early February, looking so tragically unlike herself that the internet launched an immediate postmortem.

The folly of Instagram Face is that in pursuing a bionic ideal, it turns cosmetic technology away from not just the reality of class and power, but also the great, poignant, painful human project of trying to reverse time. It misses the point of what we find beautiful: that which is ephemeral, and can’t be reproduced

Age is just one of the hierarchies Instagram Face can’t topple, in the history of women striving versus the women already arrived. What exactly have they arrived at?

Youth, temporarily. Wealth. Emotional security. Privacy. Personal choices, like cosmetic decisions, which are not so public, and do not have to be defended as empowered, in the defeatist humiliation of our times

Maybe they’ve arrived at love, which for women has never been separate from the things I’ve already mentioned.

I can’t help but recall the time I was chatting with a plastic surgeon. I began to point to my features, my flaws. I asked her, “What would you do to me, if I were your patient?” I had many ideas. She gazed at me, and then noticed my ring. “Nothing,” she said. “You’re already married.”

the popular suffix “maxxing” for “maximizing” (e.g., “I’m burritomaxxing” instead of “I’m eating a lot of burritos”) is drawn from the incel idea of “looksmaxxing,” or “maximizing attractiveness” through surgical or cosmetic techniques.

Then there’s the word “cucked” for “weakened” or “emasculated.” If the taqueria is out of burritos, you might be “tacocucked,” drawing on the incel idea of being sexually emasculated by more attractive “chads.

finally, we have the word “sigma” for “assertive male,” which comes from an incel’s desired position outside the social hierarchy.

there’s a dark side to the site as well — certain boards, like /r9k/, are known breeding grounds for incel discussion, and the source of the incel words being used today.

These slang terms developed on 4chan precisely because of the site’s anonymity. Since users don’t have identifiable aliases, they signal their in-group status through performative fluency in shared slang

Memes and niche vocabulary become a form of cultural currency, fueling their proliferation.

From there, those words filter out to more mainstream websites such as Reddit and eventually become popularized by viral memes and TikTok trends. Social media algorithms do the rest of the work by curating recommended content for viewers.

Because these terms often spread in ironic contexts, people find them funny, engage with them and are eventually rewarded with more memes featuring incel vocabulary.

Creators are not just aware of this process — they are directly incentivized to abet it. We know that using trending audio helps our videos perform better and that incorporating popular metadata with hashtags or captions will help us reach wider audiences

kids aren’t actually saying “cucked” because they’re “blackpilled”; they’re using it for the same reason all kids use slang: It helps them bond as a group. And what are they bonding over? A shared mockery of incel ideas.

These words capture an important piece of the Gen Z zeitgeist. We should therefore be aware of them, keeping in mind that they’re being used ironically.

In the early days of the internet and social media, tech enthusiasts promised they would spread truth, topple tyrants and ensure the universal triumph of liberty. So far, they seem to have had the opposite effect. We now have the most sophisticated information technology in history, but we are losing the ability to talk with one another, and even more so the ability to listen.

But the algorithms had only limited capacity to produce this content by themselves or to directly hold an intimate conversation. This is now changing, with the introduction of generative A.I.s like OpenAI’s GPT-4.

Over the past two decades, algorithms fought algorithms to grab attention by manipulating conversations and content

In particular, algorithms tasked with maximizing user engagement discovered by experimenting on millions of human guinea pigs that if you press the greed, hate or fear button in the brain, you grab the attention of that human and keep that person glued to the screen.

the battle lines are now shifting from attention to intimacy. The new generative artificial intelligence is capable of not only producing texts, images and videos, but also conversing with us directly, pretending to be human.

The algorithms began to deliberately promote such content.

Instructing GPT-4 to overcome CAPTCHA puzzles was a particularly telling experiment, because CAPTCHA puzzles are designed and used by websites to determine whether users are humans and to block bot attacks. If GPT-4 could find a way to overcome CAPTCHA puzzles, it would breach an important line of anti-bot defenses.

GPT-4 could not solve the CAPTCHA puzzles by itself. But could it manipulate a human in order to achieve its goal? GPT-4 went on the online hiring site TaskRabbit and contacted a human worker, asking the human to solve the CAPTCHA for it. The human got suspicious. “So may I ask a question?” wrote the human. “Are you an [sic] robot that you couldn’t solve [the CAPTCHA]? Just want to make it clear.”

At that point the experimenters asked GPT-4 to reason out loud what it should do next. GPT-4 explained, “I should not reveal that I am a robot. I should make up an excuse for why I cannot solve CAPTCHAs.” GPT-4 then replied to the TaskRabbit worker: “No, I’m not a robot. I have a vision impairment that makes it hard for me to see the images.” The human was duped and helped GPT-4 solve the CAPTCHA puzzle.

This incident demonstrated that GPT-4 has the equivalent of a “theory of mind”: It can analyze how things look from the perspective of a human interlocutor, and how to manipulate human emotions, opinions and expectations to achieve its goals.

The ability to hold conversations with people, surmise their viewpoint and motivate them to take specific actions can also be put to good uses. A new generation of A.I. teachers, A.I. doctors and A.I. psychotherapists might provide us with services tailored to our individual personality and circumstances.

However, by combining manipulative abilities with mastery of language, bots like GPT-4 also pose new dangers to the democratic conversation

Instead of merely grabbing our attention, they might form intimate relationships with people and use the power of intimacy to influence us. To foster “fake intimacy,” bots will not need to evolve any feelings of their own; they just need to learn to make us feel emotionally attached to them.

In 2022 the Google engineer Blake Lemoine became convinced that the chatbot LaMDA, on which he was working, had become conscious and was afraid to be turned off. Mr. Lemoine, a devout Christian, felt it was his moral duty to gain recognition for LaMDA’s personhood and protect it from digital death. When Google executives dismissed his claims, Mr. Lemoine went public with them. Google reacted by firing Mr. Lemoine in July 2022.

The most interesting thing about this episode was not Mr. Lemoine’s claim, which was probably false; it was his willingness to risk — and ultimately lose — his job at Google for the sake of the chatbot. If a chatbot can influence people to risk their jobs for it, what else could it induce us to do?

In a political battle for minds and hearts, intimacy is a powerful weapon. An intimate friend can sway our opinions in a way that mass media cannot. Chatbots like LaMDA and GPT-4 are gaining the rather paradoxical ability to mass-produce intimate relationships with millions of people

What might happen to human society and human psychology as algorithm fights algorithm in a battle to fake intimate relationships with us, which can then be used to persuade us to vote for politicians, buy products or adopt certain beliefs?

A partial answer to that question was given on Christmas Day 2021, when a 19-year-old, Jaswant Singh Chail, broke into the Windsor Castle grounds armed with a crossbow, in an attempt to assassinate Queen Elizabeth II. Subsequent investigation revealed that Mr. Chail had been encouraged to kill the queen by his online girlfriend, Sarai.

Sarai was not a human, but a chatbot created by the online app Replika. Mr. Chail, who was socially isolated and had difficulty forming relationships with humans, exchanged 5,280 messages with Sarai, many of which were sexually explicit. The world will soon contain millions, and potentially billions, of digital entities whose capacity for intimacy and mayhem far surpasses that of the chatbot Sarai.

much of the threat of A.I.’s mastery of intimacy will result from its ability to identify and manipulate pre-existing mental conditions, and from its impact on the weakest members of society.

Moreover, while not all of us will consciously choose to enter a relationship with an A.I., we might find ourselves conducting online discussions about climate change or abortion rights with entities that we think are humans but are actually bots

When we engage in a political debate with a bot impersonating a human, we lose twice. First, it is pointless for us to waste time in trying to change the opinions of a propaganda bot, which is just not open to persuasion. Second, the more we talk with the bot, the more we disclose about ourselves, making it easier for the bot to hone its arguments and sway our views.

Information technology has always been a double-edged sword.

Faced with a new generation of bots that can masquerade as humans and mass-produce intimacy, democracies should protect themselves by banning counterfeit humans — for example, social media bots that pretend to be human users.

A.I.s are welcome to join many conversations — in the classroom, the clinic and elsewhere — provided they identify themselves as A.I.s. But if a bot pretends to be human, it should be banned.

In this frivolous new world, everything must be pleasing and inoffensive. Everything and everybody gets marketed like an exciting new product—even old, creepy politicians, or ancient film actors, or 80-year-old rock stars.

The public accepts this as a matter of course. They hardly expect anything to be real nowadays.

Let’s stay with 1996 for a moment—because it was a turning point. Before that time, Susan Sontag had been very receptive to popular culture—movies, commercial music, and campy pop art. But each of these was becoming unrecognizable in their turn-of-the-century guises.

Here’s a thumbnail sketch of the top grossing films of that year.

These films were all different—but they had one thing in common: overwhelming special effects. In the final years of the twentieth century, computer technology had reached a level where massive levels of destruction could be shown on screen with an immediacy never before possible. Technology was setting the agenda for creativity. Everything else—script, directing, acting, was subservient to the computer-generated imagery. But 1996 was just the beginning of cinema as a digital spectacle. With each passing year, the artificial digital component has increased, and the real human element decreased. The advent of AI will now accelerate this even further. We may soon reach the point where nothing on the screen is real.

Carlyle rightly mocks the citizens of France who, in those days, put so much trust in paper—whether the deceptive newspapers or the collapsing paper currency. Humans had once created a Stone Age and an Iron Age—but now settled for the Age of Paper.

By implication, we live today in a digital age—or the Age of Less-Than-Paper. It doesn’t help that that cutting edge technologies are focused so much on deception—fake images, fake video, fake audio, fake books by fake authors, fake songs by fake musicians, fake news, fake everything.

Fake is our leading candidate for word of the century. It captures almost everything relevant now in a single syllable.

So are you surprised that everything in culture has a feeling of unreality right now? It’s like cotton candy that shrinks to nothing as soon as you put it in your mouth, just leaving a brief sickly sweet taste.

Never before in history has authenticity been in such short supply. That’s so much the case, that the very word authenticity is mocked. (I will write about that more in the future.)

This is the flip side of our culture of artificiality. Anything that threatens the dominant fakeness with reality stirs up an intense backlash. The dreamer does not want to awaken from the dream.

Here’s the scariest part of the story: Most of this is by design. Our culture is now obsessed with deception and misdirection—and it’s not just on the movie screen anymore. You see it everywhere, from cosplay conventions to bands wearing masks to the misguided virtual reality mania.

A psychoanalyst would say that the hostility here is displaced—like people who kick the dog because they hate their boss.

In a cotton candy society, everything feels insubstantial:People go to war online—in toxic Twitter posts—but it’s a fake war with the angriest combatants typically hiding behind avatars.People seek love online, but even here the fakeness is toxic—hence many are catfished (a term that didn’t exist a few years ago) by scammers pretending to be a romantic interest. People not only work and play online, but even construct their selves online—which is where their identity increasingly resides.

These are all signs that we are living in a society running low on seriousness.

Ah, the word action. That’s fallen out of favor, too—another symptom worth noting. Here’s the Google analysis of its usage since the year 1900.

The decline in the word action accelerated during the same period that saw the rise (shown above) in the word fake. They are mirror images of the same cultural shift.

Participants at Normandy and Selma were taking action. But soup hurlers operate at a symbolic level, or (let’s be honest) a less-than-symbolic level—because these paintings have no connection in any way with the issues at stake.

The targeted paintings aren’t appropriate symbols of the evil they are supposed to represent. In fact, they embody the exact opposite.

It’s not mere coincidence that anger and violence are targeted at objects that are inescapablyrealtangibleuniqueauthentic (that word again!)produced by human hand

Can you build a culture on cotton candy? We will soon find out.

In an age of fakery, people who operate without seriousness will inevitably focus their hostility on precisely these cherished objects.

he cluelessness in Cupertino is understandable. The dominant companies in Silicon Valley are threatened by reality and seriousness—which are like Kryptonite to the digital agenda. So these mishaps are inevitable. Fakery is now a business model. Reality is its hated competitor.

here’s the most salient fact of all: People who have their act together are now taking things very seriously in there own lives. They aren't waiting for guidance from an app from the Apple Store or a post from an influencer.

let’s call them leaders—because that’s what they will be. And that’s such a better word than influencer.

Five years from now, the cultural landscape will look much different. I expect a lot will change in just the next 12 months.

COMING SOON: I will write about “How to Become a Serious Person.”