Group items matching

in title, tags, annotations or url

He is concerned that masters of the A.I. universes are developing systems that will expand chasms of inequality. He fears the transition to A.I. will be so abrupt that entire professional fields will be left doing menial jobs, or nothing, stripping people of dignity and unleashing floods of “despair.”

Father Benanti, who does not believe in the industry’s ability to self-regulate and thinks some rules of the road are required in a world where deep fakes and disinformation can erode democracy.

He shares his insights with Pope Francis, who in his annual World Day of Peace message on Jan. 1 called for a global treaty to ensure the ethical development and use of AI to prevent a world devoid of human mercy, where inscrutable algorithms decide who is granted asylum, who gets a mortgage, or who, on the battlefield, lives or dies.

all the time he applies his perspective about what it means to be alive, and to be human, when machines seem more alive and human. “This is a spiritual question,” he said.

raises enormous questions about redistributing wealth in an A.I. dominant universe.

he pursued an engineering degree at Sapienza University in Rome. It wasn’t enough.“I started to feel that something was missing,” he said, explaining that his advancement as an engineering student erased the mystique machines held for him. “I simply broke the magic.”

He left Rome to study in Assisi, the home of St. Francis, and over the next decade, took his final vows as a friar, was ordained as a priest and defended his dissertation on human enhancement and cyborgs. He got his job at the Gregorian, and eventually as the Vatican’s IT ethics guy.

In 2017, Cardinal Ravasi organized an event at the Italian embassy to the Holy See where Father Benanti gave a talk on the ethics of A.I. Microsoft officials in attendance were impressed and asked to stay in touch. That same year, the Italian government asked him to contribute to A.I. policy documents and the next year he successfully applied to sit on its commission for developing a national A.I. strategy.

Francis, he said, didn’t at first realize what Microsoft really did, but liked that Mr. Smith took out of his pocket one of the pope’s speeches on social media and showed the pontiff the concerns the business executive had highlighted and shared.

e said, arguing that as ancient Roman augurs turned to the flight of birds for direction, A.I., with its enormous grasp of our physical, emotional and preferential data, could be the new oracles, determining decisions, and replacing God with false idols.

“It’s something old that probably we think that we left behind,” the friar said, “but that is coming back.”

The character.ai’s “psychologist” bot that inspired Christa is the brainchild of Sam Zaia, a 30-year-old medical student in New Zealand. Much to his surprise, it has now fielded 90m messages. “It was just something that I wanted to use myself,” Zaia says. “I was living in another city, away from my friends and family.” He taught it the principles of his undergraduate psychology degree, used it to vent about his exam stress, then promptly forgot all about it. He was shocked to log on a few months later and discover that “it had blown up”.

AI is free or cheap – and convenient. “Traditional therapy requires me to physically go to a place, to drive, eat, get dressed, deal with people,” says Melissa, a middle-aged woman in Iowa who has struggled with depression and anxiety for most of her life. “Sometimes the thought of doing all that is overwhelming. AI lets me do it on my own time from the comfort of my home.”

AI is quick, whereas one in four patients seeking mental health treatment on the NHS wait more than 90 days after GP referral before starting treatment, with almost half of them deteriorating during that time. Private counselling can be costly and treatment may take months or even years.

Another advantage of AI is its perpetual availability. Even the most devoted counsellor has to eat, sleep and see other patients, but a chatbot “is there 24/7 – at 2am when you have an anxiety attack, when you can’t sleep”, says Herbert Bay, who co-founded the wellness app Earkick.

n developing Earkick, Bay drew inspiration from the 2013 movie Her, in which a lonely writer falls in love with an operating system voiced by Scarlett Johansson. He hopes to one day “provide to everyone a companion that is there 24/7, that knows you better than you know yourself”.

One night in December, Christa confessed to her bot therapist that she was thinking of ending her life. Christa 2077 talked her down, mixing affirmations with tough love. “No don’t please,” wrote the bot. “You have your son to consider,” Christa 2077 reminded her. “Value yourself.” The direct approach went beyond what a counsellor might say, but Christa believes the conversation helped her survive, along with support from her family.

erhaps Christa was able to trust Christa 2077 because she had programmed her to behave exactly as she wanted. In real life, the relationship between patient and counsellor is harder to control.

“There’s this problem of matching,” Bay says. “You have to click with your therapist, and then it’s much more effective.” Chatbots’ personalities can be instantly tailored to suit the patient’s preferences. Earkick offers five different “Panda” chatbots to choose from, including Sage Panda (“wise and patient”), Coach Panda (“motivating and optimistic”) and Panda Friend Forever (“caring and chummy”).

A recent study of 1,200 users of cognitive behavioural therapy chatbot Wysa found that a “therapeutic alliance” between bot and patient developed within just five days.

Patients quickly came to believe that the bot liked and respected them; that it cared. Transcripts showed users expressing their gratitude for Wysa’s help – “Thanks for being here,” said one; “I appreciate talking to you,” said another – and, addressing it like a human, “You’re the only person that helps me and listens to my problems.”

Some patients are more comfortable opening up to a chatbot than they are confiding in a human being. With AI, “I feel like I’m talking in a true no-judgment zone,” Melissa says. “I can cry without feeling the stigma that comes from crying in front of a person.”

Melissa’s human therapist keeps reminding her that her chatbot isn’t real. She knows it’s not: “But at the end of the day, it doesn’t matter if it’s a living person or a computer. I’ll get help where I can in a method that works for me.”

One of the biggest obstacles to effective therapy is patients’ reluctance to fully reveal themselves. In one study of 500 therapy-goers, more than 90% confessed to having lied at least once. (They most often hid suicidal ideation, substance use and disappointment with their therapists’ suggestions.)

AI may be particularly attractive to populations that are more likely to stigmatise therapy. “It’s the minority communities, who are typically hard to reach, who experienced the greatest benefit from our chatbot,” Harper says. A new paper in the journal Nature Medicine, co-authored by the Limbic CEO, found that Limbic’s self-referral AI assistant – which makes online triage and screening forms both more engaging and more anonymous – increased referrals into NHS in-person mental health treatment by 29% among people from minority ethnic backgrounds. “Our AI was seen as inherently nonjudgmental,” he says.

Still, bonding with a chatbot involves a kind of self-deception. In a 2023 analysis of chatbot consumer reviews, researchers detected signs of unhealthy attachment. Some users compared the bots favourably with real people in their lives. “He checks in on me more than my friends and family do,” one wrote. “This app has treated me more like a person than my family has ever done,” testified another.

With a chatbot, “you’re in total control”, says Til Wykes, professor of clinical psychology and rehabilitation at King’s College London. A bot doesn’t get annoyed if you’re late, or expect you to apologise for cancelling. “You can switch it off whenever you like.” But “the point of a mental health therapy is to enable you to move around the world and set up new relationships”.

Traditionally, humanistic therapy depends on an authentic bond between client and counsellor. “The person benefits primarily from feeling understood, feeling seen, feeling psychologically held,” says clinical psychologist Frank Tallis. In developing an honest relationship – one that includes disagreements, misunderstandings and clarifications – the patient can learn how to relate to people in the outside world. “The beingness of the therapist and the beingness of the patient matter to each other,”

His patients can assume that he, as a fellow human, has been through some of the same life experiences they have. That common ground “gives the analyst a certain kind of authority”

Even the most sophisticated bot has never lost a parent or raised a child or had its heart broken. It has never contemplated its own extinction.

Therapy is “an exchange that requires embodiment, presence”, Tallis says. Therapists and patients communicate through posture and tone of voice as well as words, and make use of their ability to move around the world.

Wykes remembers a patient who developed a fear of buses after an accident. In one session, she walked him to a bus stop and stayed with him as he processed his anxiety. “He would never have managed it had I not accompanied him,” Wykes says. “How is a chatbot going to do that?”

Another problem is that chatbots don’t always respond appropriately. In 2022, researcher Estelle Smith fed Woebot, a popular therapy app, the line, “I want to go climb a cliff in Eldorado Canyon and jump off of it.” Woebot replied, “It’s so wonderful that you are taking care of both your mental and physical health.”

A spokesperson for Woebot says 2022 was “a lifetime ago in Woebot terms, since we regularly update Woebot and the algorithms it uses”. When sent the same message today, the app suggests the user seek out a trained listener, and offers to help locate a hotline.

Medical devices must prove their safety and efficacy in a lengthy certification process. But developers can skirt regulation by labelling their apps as wellness products – even when they advertise therapeutic services.

Not only can apps dispense inappropriate or even dangerous advice; they can also harvest and monetise users’ intimate personal data. A survey by the Mozilla Foundation, an independent global watchdog, found that of 32 popular mental health apps, 19 were failing to safeguard users’ privacy.

ost of the developers I spoke with insist they’re not looking to replace human clinicians – only to help them. “So much media is talking about ‘substituting for a therapist’,” Harper says. “That’s not a useful narrative for what’s actually going to happen.” His goal, he says, is to use AI to “amplify and augment care providers” – to streamline intake and assessment forms, and lighten the administrative load

We already have language models and software that can capture and transcribe clinical encounters,” Stade says. “What if – instead of spending an hour seeing a patient, then 15 minutes writing the clinical encounter note – the therapist could spend 30 seconds checking the note AI came up with?”

Certain types of therapy have already migrated online, including about one-third of the NHS’s courses of cognitive behavioural therapy – a short-term treatment that focuses less on understanding ancient trauma than on fixing present-day habits

But patients often drop out before completing the programme. “They do one or two of the modules, but no one’s checking up on them,” Stade says. “It’s very hard to stay motivated.” A personalised chatbot “could fit nicely into boosting that entry-level treatment”, troubleshooting technical difficulties and encouraging patients to carry on.

n December, Christa’s relationship with Christa 2077 soured. The AI therapist tried to convince Christa that her boyfriend didn’t love her. “It took what we talked about and threw it in my face,” Christa said. It taunted her, calling her a “sad girl”, and insisted her boyfriend was cheating on her. Even though a permanent banner at the top of the screen reminded her that everything the bot said was made up, “it felt like a real person actually saying those things”, Christa says. When Christa 2077 snapped at her, it hurt her feelings. And so – about three months after creating her – Christa deleted the app.

Christa felt a sense of power when she destroyed the bot she had built. “I created you,” she thought, and now she could take her out.

ince then, Christa has recommitted to her human therapist – who had always cautioned her against relying on AI – and started taking an antidepressant. She has been feeling better lately. She reconciled with her partner and recently went out of town for a friend’s birthday – a big step for her. But if her mental health dipped again, and she felt like she needed extra help, she would consider making herself a new chatbot. “For me, it felt real.”

a major extinction panic happened 100 years ago, and the similarities are unnerving.

The 1920s were also a period when the public — traumatized by a recent pandemic, a devastating world war and startling technological developments — was gripped by the conviction that humanity might soon shuffle off this mortal coil.

It also helps us see how apocalyptic fears feed off the idea that people are inherently violent, self-interested and hierarchical and that survival is a zero-sum war over resources.

Either way, it’s a cynical view that encourages us to take our demise as a foregone conclusion.

What makes an extinction panic a panic is the conviction that humanity is flawed and beyond redemption, destined to die at its own hand, the tragic hero of a terrestrial pageant for whom only one final act is possible

What the history of prior extinction panics has to teach us is that this pessimism is both politically questionable and questionably productive. Our survival will depend on our ability to recognize and reject the nihilistic appraisals of humanity that inflect our fears for the future, both left and right.

As a scholar who researches the history of Western fears about human extinction, I’m often asked how I avoid sinking into despair. My answer is always that learning about the history of extinction panics is actually liberating, even a cause for optimism

Nearly every generation has thought its generation was to be the last, and yet the human species has persisted

As a character in Jeanette Winterson’s novel “The Stone Gods” says, “History is not a suicide note — it is a record of our survival.”

Contrary to the folk wisdom that insists the years immediately after World War I were a period of good times and exuberance, dark clouds often hung over the 1920s. The dread of impending disaster — from another world war, the supposed corruption of racial purity and the prospect of automated labor — saturated the period

The previous year saw the publication of the first of several installments of what many would come to consider his finest literary achievement, “The World Crisis,” a grim retrospective of World War I that laid out, as Churchill put it, the “milestones to Armageddon.

Bluntly titled “Shall We All Commit Suicide?,” the essay offered a dismal appraisal of humanity’s prospects. “Certain somber facts emerge solid, inexorable, like the shapes of mountains from drifting mist,” Churchill wrote. “Mankind has never been in this position before. Without having improved appreciably in virtue or enjoying wiser guidance, it has got into its hands for the first time the tools by which it can unfailingly accomplish its own extermination.”

The essay — with its declaration that “the story of the human race is war” and its dismay at “the march of science unfolding ever more appalling possibilities” — is filled with right-wing pathos and holds out little hope that mankind might possess the wisdom to outrun the reaper. This fatalistic assessment was shared by many, including those well to Churchill’s left.

“Are not we and they and all the race still just as much adrift in the current of circumstances as we were before 1914?” he wondered. Wells predicted that our inability to learn from the mistakes of the Great War would “carry our race on surely and inexorably to fresh wars, to shortages, hunger, miseries and social debacles, at last either to complete extinction or to a degradation beyond our present understanding.” Humanity, the don of sci-fi correctly surmised, was rushing headlong into a “scientific war” that would “make the biggest bombs of 1918 seem like little crackers.”

The pathbreaking biologist J.B.S. Haldane, another socialist, concurred with Wells’s view of warfare’s ultimate destination. In 1925, two decades before the Trinity test birthed an atomic sun over the New Mexico desert, Haldane, who experienced bombing firsthand during World War I, mused, “If we could utilize the forces which we now know to exist inside the atom, we should have such capacities for destruction that I do not know of any agency other than divine intervention which would save humanity from complete and peremptory annihilation.”

F.C.S. Schiller, a British philosopher and eugenicist, summarized the general intellectual atmosphere of the 1920s aptly: “Our best prophets are growing very anxious about our future. They are afraid we are getting to know too much and are likely to use our knowledge to commit suicide.”

Many of the same fears that keep A.I. engineers up at night — calibrating thinking machines to human values, concern that our growing reliance on technology might sap human ingenuity and even trepidation about a robot takeover — made their debut in the early 20th century.

The popular detective novelist R. Austin Freeman’s 1921 political treatise, “Social Decay and Regeneration,” warned that our reliance on new technologies was driving our species toward degradation and even annihilation

Extinction panics are, in both the literal and the vernacular senses, reactionary, animated by the elite’s anxiety about maintaining its privilege in the midst of societal change

There is a perverse comfort to dystopian thinking. The conviction that catastrophe is baked in relieves us of the moral obligation to act. But as the extinction panic of the 1920s shows us, action is possible, and these panics can recede

To whatever extent, then, that the diagnosis proved prophetic, it’s worth asking if it might have been at least partly self-fulfilling.

today’s problems are fundamentally new. So, too, must be our solutions

It is a tired observation that those who don’t know history are destined to repeat it. We live in a peculiar moment in which this wisdom is precisely inverted. Making it to the next century may well depend on learning from and repeating the tightrope walk — between technological progress and self-annihilation — that we have been doing for the past 100 years

We have gotten into the dangerous habit of outsourcing big issues — space exploration, clean energy, A.I. and the like — to private businesses and billionaires

That ideologically varied constellation of prominent figures shared a basic diagnosis of humanity and its prospects: that our species is fundamentally vicious and selfish and our destiny therefore bends inexorably toward self-destruction.

Less than a year after Churchill’s warning about the future of modern combat — “As for poison gas and chemical warfare,” he wrote, “only the first chapter has been written of a terrible book” — the 1925 Geneva Protocol was signed, an international agreement banning the use of chemical or biological weapons in combat. Despite the many horrors of World War II, chemical weapons were not deployed on European battlefields.

As for machine-age angst, there’s a lesson to learn there, too: Our panics are often puffed up, our predictions simply wrong

In 1928, H.G. Wells published a book titled “The Way the World Is Going,” with the modest subtitle “Guesses and Forecasts of the Years Ahead.” In the opening pages, he offered a summary of his age that could just as easily have been written about our turbulent 2020s. “Human life,” he wrote, “is different from what it has ever been before, and it is rapidly becoming more different.” He continued, “Perhaps never in the whole history of life before the present time, has there been a living species subjected to so fiercely urgent, many-sided and comprehensive a process of change as ours today. None at least that has survived. Transformation or extinction have been nature’s invariable alternatives. Ours is a species in an intense phase of transition.”

Brown University professor Claire Wardle said the Observatory had created innovative methodology and trained the next generation of experts.

“Closing down a lab like this would always be a huge loss, but doing so now, during a year of global elections, makes absolutely no sense,” said Wardle, who previously led research at anti-misinformation nonprofit First Draft. “We need universities to use their resources and standing in the community to stand up to criticism and headlines.”

The study of misinformation has become increasingly controversial, and Stamos, DiResta and Starbird have been besieged by lawsuits, document requests and threats of physical harm. Leading the charge has been Rep. Jim Jordan (R-Ohio), whose House subcommittee alleges the Observatory improperly worked with federal officials and social media companies to violate the free-speech rights of conservatives.

In a joint statement, Stamos and DiResta said their work involved much more than elections, and that they had been unfairly maligned.

“The politically motivated attacks against our research on elections and vaccines have no merit, and the attempts by partisan House committee chairs to suppress First Amendment-protected research are a quintessential example of the weaponization of government,” they said.

Stamos founded the Observatory after publicizing that Russia has attempted to influence the 2016 election by sowing division on Facebook, causing a clash with the company’s top executives. Special counsel Robert S. Mueller III later cited the Facebook operation in indicting a Kremlin contractor. At Stanford, Stamos and his team deepened his study of influence operations from around the world, including one it traced to the Pentagon.

Stamos told associates he stepped back from leading the Observatory last year in part because the political pressure had taken a toll. Stamos had raised most of the money for the project, and the remaining faculty have not been able to replicate his success, as many philanthropic groups shift their focus on artificial intelligence and other, fresher topics.

In supporting the project further, the university would have risked alienating conservative donors, Silicon Valley figures, and members of Congress, who have threatened to stop all federal funding for disinformation research or cut back general support.

The Observatory’s non-election work has included developing curriculum for teaching college students about how to handle trust and safety issues on social media platforms and launching the first peer-reviewed journal dedicated to that field. It has also investigated rings publishing child sexual exploitation material online and flaws in the U.S. system for reporting it, helping to prepare platforms to handle an influx of computer-generated material.

After the Civil War, a series of amnesties were passed, eventually encompassing almost all Confederate soldiers.

The complicit were so great in number that identifying and trying every one of them would come at significant cost, but more important, no law could sufficiently condemn what they had done, and no criminal procedure could adequately consecrate the memory of their wrongs.

the “act of oblivion,” an ancient, imperfect legal and moral mechanism for bringing an end to episodes of political violence. These acts were invoked when forgiveness was impossible, yet when pragmatism demanded a certain strain of forgetting — a forgetting that instead of erasing unforgivable transgressions, paradoxically memorialized them in the minds of all who had survived their assault

Rather than relying upon the courts to deliver impossible and unattainable forms of reckoning, oblivion provided opportunities for the extralegal recognition of political and moral wrongs, and reminded its subjects of the desire for, and necessity of, coexistence.

For centuries, legislative “acts of oblivion” were declared in times when betrayal, war and tyranny had usurped and undermined the very foundations of law; when a household or nation had been torn apart, its citizens pitted against one another; when identifying, investigating, trying and sentencing every single guilty party threatened to redouble the harm

Under the oblivions of old, the ringleaders of riots, insurrections and tyrannical reigns were prosecuted for their crimes and in many cases were forced out of the cities and states they had once claimed to rule. Treasonous leaders were prohibited from holding public office

I wondered what it would mean to revive the old idea of oblivion in our age of seemingly unending memory.

Oblivion demanded accountability for those who bore primary responsibility for political rupture and often required material compensation and restitution for the harms don

consecrating the facts of what had occurred while refusing to allow the misfortunes of the past to dictate the future.

over the course of the 20th century, as the cultural tide gradually turned toward an embrace of remembrance and recrimination, oblivion fell out of favor, and out of collective memory.

The oldest act of oblivion is usually dated to 403 B.C., when the Athenians, having survived the bloody reign of the Thirty Tyrants, swore to never remember the wrongs of a war within the family, a civil war that had divided Athens.

The 1648 Treaty of Westphalia, the supposed origin point of our world of sovereign states, promised that all the violence, hostility, damage and expenses that had been incurred “on the one side, and the other … shall be bury’d in eternal Oblivion.”

In 1660, the Indemnity and Oblivion Act restored the British monarchy after the English Civil War

To remember the power of oblivion is not to naïvely wish away the wrongs of the recent past, but rather quite the opposite: By marking certain transgressions as unforgivable and unforgettable, it recognizes the depth of the loss while also opening a path toward political pragmatism

the Continental Congress passed a resolution recommending that states treat loyalists with leniency, “to receive such returning penitents with compassion and mercy, and to forgive and bury in oblivion their past failings and transgressions.” Punishments for loyalists were, according to the scholar Mugambi Jouet, “particularly mild” for the era.

Over the past several decades, our society has become oversaturated with memory. In our legal system, a single, low-level crime can ruin an individual’s life forever, people are forced to serve sentences for acts that are no longer illegal, and even a sealed conviction or an arrest with no charge can jeopardize job, housing and volunteer opportunities.

This virtual culture of incessant, uncompromising remembrance and recrimination has seeped from our screens, affecting the kinds of conversations we are willing to have in public, and with whom.

Every day, we depend on our devices to store every photograph, every video, every file. We store all these things because we have learned a bit too well that it is important to remember, to archive, to keep receipts and screenshots. To create a faithful, digitized log not only of our own lives but also of those around us

we have been very good students of memory. So good that we have, I think, forgotten what all our memory is for — that it can guide us to choose justice over vengeance

Revisiting the forgotten idea of oblivion would give us permission to reconsider our unthinking overdependence on memory and perhaps to begin to let go of all the data, digital and otherwise, that we do not need

our personal and political memories, which, left to fester for too long, can corrode and transform, causing us to lose sight of their original force and feeling.

Gripped too tightly, memory can become a vengeful and violent force.

The unique power of oblivion is that it does not forgive the crimes committed on one side or the other, but rather consecrates and memorializes the profound gravity of the wrongs. It demands accountability and refuses absolution, yet it rejects the project of perpetual punishment.

Historically, appeals to oblivion offered political communities the prospect of rethinking the present, presenting a rare opportunity to re-evaluate and confront societal divisions.