Group items tagged

“The big problem is that the culture is such that researchers spin their work in a way that tells a prettier story than what they really found,” said Jonathan Schooler, a psychologist at the University of California, Santa Barbara. “It’s almost like everyone is on steroids, and to compete you have to take steroids as well.”

Dr. Stapel published papers on the effect of power on hypocrisy, on racial stereotyping and on how advertisements affect how people view themselves. Many of his findings appeared in newspapers around the world, including The New York Times, which reported in December on his study about advertising and identity.

In a survey of more than 2,000 American psychologists scheduled to be published this year, Leslie John of Harvard Business School and two colleagues found that 70 percent had acknowledged, anonymously, to cutting some corners in reporting data. About a third said they had reported an unexpected finding as predicted from the start, and about 1 percent admitted to falsifying data.

Dr. Stapel was able to operate for so long, the committee said, in large measure because he was “lord of the data,” the only person who saw the experimental evidence that had been gathered (or fabricated). This is a widespread problem in psychology, said Jelte M. Wicherts, a psychologist at the University of Amsterdam. In a recent survey, two-thirds of Dutch research psychologists said they did not make their raw data available for other researchers to see. “This is in violation of ethical rules established in the field,” Dr. Wicherts said.

Also common is a self-serving statistical sloppiness. In an analysis published this year, Dr. Wicherts and Marjan Bakker, also at the University of Amsterdam, searched a random sample of 281 psychology papers for statistical errors. They found that about half of the papers in high-end journals contained some statistical error, and that about 15 percent of all papers had at least one error tha

t changed a reported finding — almost always in opposition to the authors’ hypothesis.

an analysis of 49 studies appearing Wednesday in the journal PLoS One, by Dr. Wicherts, Dr. Bakker and Dylan Molenaar, found that the more reluctant that scientists were to share their data, the more likely that evidence contradicted their reported findings.

“We know the general tendency of humans to draw the conclusions they want to draw — there’s a different threshold,” said Joseph P. Simmons, a psychologist at the University of Pennsylvania’s Wharton School. “With findings we want to see, we ask, ‘Can I believe this?’ With those we don’t, we ask, ‘Must I believe this?’

The ban would only prohibit involvement in what the association defines as national security interrogations, which are those conducted by the American military or intelligence agencies, or by contractors or foreign governments outside traditional domestic criminal law enforcement inside the United States.

Psychologists played crucial roles in the post-9/11 harsh interrogation programs created by the C.I.A. and Pentagon, and their involvement helped the Bush administration claim that the abusive interrogation techniques were legal. The involvement of psychologists in the interrogations enabled the Justice Department to issue secret legal opinions arguing that the interrogations were safe because they were being monitored by health professionals, and thus did not constitute torture.

Even before Friday’s vote, the Hoffman report and its unsparing findings of collusion during the Bush administration had already had a dramatic impact on the A.P.A. Four top association officials, including its chief executive and his deputy, have left the organization since the report was released in July.

What none of these parents understand is that their children’s and teens’ destructive obsession with technology is the predictable consequence of a virtually unrecognized merger between the tech industry and psychology.

Dr. B.J. Fogg, is a psychologist and the father of persuasive technology, a discipline in which digital machines and apps — including smartphones, social media, and video games — are configured to alter human thoughts and behaviors. As the lab’s website boldly proclaims: “Machines designed to change humans.”

These parents have no idea that lurking behind their kids’ screens and phones are a multitude of psychologists, neuroscientists, and social science experts who use their knowledge of psychological vulnerabilities to devise products that capture kids’ attention for the sake of industry profit.

psychology — a discipline that we associate with healing — is now being used as a weapon against children.

This alliance pairs the consumer tech industry’s immense wealth with the most sophisticated psychological research, making it possible to develop social media, video games, and phones with drug-like power to seduce young users.

Likewise, social media companies use persuasive design to prey on the age-appropriate desire for preteen and teen kids, especially girls, to be socially successful. This drive is built into our DNA, since real-world relational skills have fostered human evolution.

Called “the millionaire maker,” Fogg has groomed former students who have used his methods to develop technologies that now consume kids’ lives. As he recently touted on his personal website, “My students often do groundbreaking projects, and they continue having impact in the real world after they leave Stanford… For example, Instagram has influenced the behavior of over 800 million people. The co-founder was a student of mine.”

Persuasive technology (also called persuasive design) works by deliberately creating digital environments that users feel fulfill their basic human drives — to be social or obtain goals — better than real-world alternatives.

Kids spend countless hours in social media and video game environments in pursuit of likes, “friends,” game points, and levels — because it’s stimulating, they believe that this makes them happy and successful, and they find it easier than doing the difficult but developmentally important activities of childhood.

While persuasion techniques work well on adults, they are particularly effective at influencing the still-maturing child and teen brain.

“Video games, better than anything else in our culture, deliver rewards to people, especially teenage boys,” says Fogg. “Teenage boys are wired to seek competency. To master our world and get better at stuff. Video games, in dishing out rewards, can convey to people that their competency is growing, you can get better at something second by second.”

it’s persuasive design that’s helped convince this generation of boys they are gaining “competency” by spending countless hours on game sites, when the sad reality is they are locked away in their rooms gaming, ignoring school, and not developing the real-world competencies that colleges and employers demand.

Persuasive technologies work because of their apparent triggering of the release of dopamine, a powerful neurotransmitter involved in reward, attention, and addiction.

As she says, “If you don’t get 100 ‘likes,’ you make other people share it so you get 100…. Or else you just get upset. Everyone wants to get the most ‘likes.’ It’s like a popularity contest.”

there are costs to Casey’s phone obsession, noting that the “girl’s phone, be it Facebook, Instagram or iMessage, is constantly pulling her away from her homework, sleep, or conversations with her family.

Casey says she wishes she could put her phone down. But she can’t. “I’ll wake up in the morning and go on Facebook just… because,” she says. “It’s not like I want to or I don’t. I just go on it. I’m, like, forced to. I don’t know why. I need to. Facebook takes up my whole life.”

B.J. Fogg may not be a household name, but Fortune Magazine calls him a “New Guru You Should Know,” and his research is driving a worldwide legion of user experience (UX) designers who utilize and expand upon his models of persuasive design.

“No one has perhaps been as influential on the current generation of user experience (UX) designers as Stanford researcher B.J. Fogg.”

the core of UX research is about using psychology to take advantage of our human vulnerabilities.

As Fogg is quoted in Kosner’s Forbes article, “Facebook, Twitter, Google, you name it, these companies have been using computers to influence our behavior.” However, the driving force behind behavior change isn’t computers. “The missing link isn’t the technology, it’s psychology,” says Fogg.

UX researchers not only follow Fogg’s design model, but also his apparent tendency to overlook the broader implications of persuasive design. They focus on the task at hand, building digital machines and apps that better demand users’ attention, compel users to return again and again, and grow businesses’ bottom line.

the “Fogg Behavior Model” is a well-tested method to change behavior and, in its simplified form, involves three primary factors: motivation, ability, and triggers.

“We can now create machines that can change what people think and what people do, and the machines can do that autonomously.”

Regarding ability, Fogg suggests that digital products should be made so that users don’t have to “think hard.” Hence, social networks are designed for ease of use

Finally, Fogg says that potential users need to be triggered to use a site. This is accomplished by a myriad of digital tricks, including the sending of incessant notifications

moral questions about the impact of turning persuasive techniques on children and teens are not being asked. For example, should the fear of social rejection be used to compel kids to compulsively use social media? Is it okay to lure kids away from school tasks that demand a strong mental effort so they can spend their lives on social networks or playing video games that don’t make them think much at all?

Describing how his formula is effective at getting people to use a social network, the psychologist says in an academic paper that a key motivator is users’ desire for “social acceptance,” although he says an even more powerful motivator is the desire “to avoid being socially rejected.”

the startup Dopamine Labs boasts about its use of persuasive techniques to increase profits: “Connect your app to our Persuasive AI [Artificial Intelligence] and lift your engagement and revenue up to 30% by giving your users our perfect bursts of dopamine,” and “A burst of Dopamine doesn’t just feel good: it’s proven to re-wire user behavior and habits.”

Ramsay Brown, the founder of Dopamine Labs, says in a KQED Science article, “We have now developed a rigorous technology of the human mind, and that is both exciting and terrifying. We have the ability to twiddle some knobs in a machine learning dashboard we build, and around the world hundreds of thousands of people are going to quietly change their behavior in ways that, unbeknownst to them, feel second-nature but are really by design.”

Programmers call this “brain hacking,” as it compels users to spend more time on sites even though they mistakenly believe it’s strictly due to their own conscious choices.

Banks of computers employ AI to “learn” which of a countless number of persuasive design elements will keep users hooked

A persuasion profile of a particular user’s unique vulnerabilities is developed in real time and exploited to keep users on the site and make them return again and again for longer periods of time. This drives up profits for consumer internet companies whose revenue is based on how much their products are used.

“The leaders of Internet companies face an interesting, if also morally questionable, imperative: either they hijack neuroscience to gain market share and make large profits, or they let competitors do that and run away with the market.”

Social media and video game companies believe they are compelled to use persuasive technology in the arms race for attention, profits, and survival.

Children’s well-being is not part of the decision calculus.

one breakthrough occurred in 2017 when Facebook documents were leaked to The Australian. The internal report crafted by Facebook executives showed the social network boasting to advertisers that by monitoring posts, interactions, and photos in real time, the network is able to track when teens feel “insecure,” “worthless,” “stressed,” “useless” and a “failure.”

The report also bragged about Facebook’s ability to micro-target ads down to “moments when young people need a confidence boost.”

These design techniques provide tech corporations a window into kids’ hearts and minds to measure their particular vulnerabilities, which can then be used to control their behavior as consumers. This isn’t some strange future… this is now.

The official tech industry line is that persuasive technologies are used to make products more engaging and enjoyable. But the revelations of industry insiders can reveal darker motives.

Revealing the hard science behind persuasive technology, Hopson says, “This is not to say that players are the same as rats, but that there are general rules of learning which apply equally to both.”

After penning the paper, Hopson was hired by Microsoft, where he helped lead the development of the Xbox Live, Microsoft’s online gaming system

“If game designers are going to pull a person away from every other voluntary social activity or hobby or pastime, they’re going to have to engage that person at a very deep level in every possible way they can.”

This is the dominant effect of persuasive design today: building video games and social media products so compelling that they pull users away from the real world to spend their lives in for-profit domains.

Persuasive technologies are reshaping childhood, luring kids away from family and schoolwork to spend more and more of their lives sitting before screens and phones.

“Since we’ve figured to some extent how these pieces of the brain that handle addiction are working, people have figured out how to juice them further and how to bake that information into apps.”

Today, persuasive design is likely distracting adults from driving safely, productive work, and engaging with their own children — all matters which need urgent attention

Still, because the child and adolescent brain is more easily controlled than the adult mind, the use of persuasive design is having a much more hurtful impact on kids.

But to engage in a pursuit at the expense of important real-world activities is a core element of addiction.

younger U.S. children now spend 5 ½ hours each day with entertainment technologies, including video games, social media, and online videos.

Even more, the average teen now spends an incredible 8 hours each day playing with screens and phones

U.S. kids only spend 16 minutes each day using the computer at home for school.

Quietly, using screens and phones for entertainment has become the dominant activity of childhood.

Younger kids spend more time engaging with entertainment screens than they do in school

teens spend even more time playing with screens and phones than they do sleeping

kids are so taken with their phones and other devices that they have turned their backs to the world around them.

many children are missing out on real-life engagement with family and school — the two cornerstones of childhood that lead them to grow up happy and successful

persuasive technologies are pulling kids into often toxic digital environments

A too frequent experience for many is being cyberbullied, which increases their risk of skipping school and considering suicide.

And there is growing recognition of the negative impact of FOMO, or the fear of missing out, as kids spend their social media lives watching a parade of peers who look to be having a great time without them, feeding their feelings of loneliness and being less than.

The combined effects of the displacement of vital childhood activities and exposure to unhealthy online environments is wrecking a generation.

as the typical age when kids get their first smartphone has fallen to 10, it’s no surprise to see serious psychiatric problems — once the domain of teens — now enveloping young kids

Self-inflicted injuries, such as cutting, that are serious enough to require treatment in an emergency room, have increased dramatically in 10- to 14-year-old girls, up 19% per year since 2009.

While girls are pulled onto smartphones and social media, boys are more likely to be seduced into the world of video gaming, often at the expense of a focus on school

it’s no surprise to see this generation of boys struggling to make it to college: a full 57% of college admissions are granted to young women compared with only 43% to young men.

Economists working with the National Bureau of Economic Research recently demonstrated how many young U.S. men are choosing to play video games rather than join the workforce.

The destructive forces of psychology deployed by the tech industry are making a greater impact on kids than the positive uses of psychology by mental health providers and child advocates. Put plainly, the science of psychology is hurting kids more than helping them.

Hope for this wired generation has seemed dim until recently, when a surprising group has come forward to criticize the tech industry’s use of psychological manipulation: tech executives

Tristan Harris, formerly a design ethicist at Google, has led the way by unmasking the industry’s use of persuasive design. Interviewed in The Economist’s 1843 magazine, he says, “The job of these companies is to hook people, and they do that by hijacking our psychological vulnerabilities.”

Marc Benioff, CEO of the cloud computing company Salesforce, is one of the voices calling for the regulation of social media companies because of their potential to addict children. He says that just as the cigarette industry has been regulated, so too should social media companies. “I think that, for sure, technology has addictive qualities that we have to address, and that product designers are working to make those products more addictive, and we need to rein that back as much as possible,”

“If there’s an unfair advantage or things that are out there that are not understood by parents, then the government’s got to come forward and illuminate that.”

Since millions of parents, for example the parents of my patient Kelly, have absolutely no idea that devices are used to hijack their children’s minds and lives, regulation of such practices is the right thing to do.

Another improbable group to speak out on behalf of children is tech investors.

How has the consumer tech industry responded to these calls for change? By going even lower.

Facebook recently launched Messenger Kids, a social media app that will reach kids as young as five years old. Suggestive that harmful persuasive design is now honing in on very young children is the declaration of Messenger Kids Art Director, Shiu Pei Luu, “We want to help foster communication [on Facebook] and make that the most exciting thing you want to be doing.”

the American Psychological Association (APA) — which is tasked with protecting children and families from harmful psychological practices — has been essentially silent on the matter

APA Ethical Standards require the profession to make efforts to correct the “misuse” of the work of psychologists, which would include the application of B.J. Fogg’s persuasive technologies to influence children against their best interests

Manipulating children for profit without their own or parents’ consent, and driving kids to spend more time on devices that contribute to emotional and academic problems is the embodiment of unethical psychological practice.

“Never before in history have basically 50 mostly men, mostly 20–35, mostly white engineer designer types within 50 miles of where we are right now [Silicon Valley], had control of what a billion people think and do.”

Some may argue that it’s the parents’ responsibility to protect their children from tech industry deception. However, parents have no idea of the powerful forces aligned against them, nor do they know how technologies are developed with drug-like effects to capture kids’ minds

Others will claim that nothing should be done because the intention behind persuasive design is to build better products, not manipulate kids

similar circumstances exist in the cigarette industry, as tobacco companies have as their intention profiting from the sale of their product, not hurting children. Nonetheless, because cigarettes and persuasive design predictably harm children, actions should be taken to protect kids from their effects.

in a 1998 academic paper, Fogg describes what should happen if things go wrong, saying, if persuasive technologies are “deemed harmful or questionable in some regard, a researcher should then either take social action or advocate that others do so.”

I suggest turning to President John F. Kennedy’s prescient guidance: He said that technology “has no conscience of its own. Whether it will become a force for good or ill depends on man.”

The APA should begin by demanding that the tech industry’s behavioral manipulation techniques be brought out of the shadows and exposed to the light of public awareness

Changes should be made in the APA’s Ethics Code to specifically prevent psychologists from manipulating children using digital machines, especially if such influence is known to pose risks to their well-being.

Moreover, the APA should follow its Ethical Standards by making strong efforts to correct the misuse of psychological persuasion by the tech industry and by user experience designers outside the field of psychology.

It should join with tech executives who are demanding that persuasive design in kids’ tech products be regulated

The APA also should make its powerful voice heard amongst the growing chorus calling out tech companies that intentionally exploit children’s vulnerabilities.

“A writer must be as objective as a chemist,” Anton Chekhov wrote in 1887. “He must abandon the subjective line; he must know that dung heaps play a very reasonable part in a landscape.”

At the turn of the century, psychology was a field quite unlike what it is now. The theoretical musings of William James were the norm (a wry commenter once noted that William James was the writer, and his brother Henry, the psychologist)

Freud was a breed of psychologist that hardly exists anymore: someone who saw the world as both writer and psychologist, and for whom there was no conflict between the two. That boundary melding allowed him to posit the existence of cognitive mechanisms that wouldn’t be empirically proved for decades,

Freud got it brilliantly right and brilliantly wrong. The rightness is as good a justification as any of the benefits, the necessity even, of knowing how to look through the eyes of a writer. The wrongness is part of the reason that the distinction between writing and experimental psychology has grown far more rigid than it was a century ago.

the signs people associate with liars often have little empirical evidence to support them. Therein lies the psychologist’s distinct role and her necessity. As a writer, you look in order to describe, but you remain free to use that description however you see fit. As a psychologist, you look to describe, yes, but also to verify.

Without verification, we can’t always trust what we see — or rather, what we think we see.

The desire for the world to be what it ought to be and not what it is permeates experimental psychology as much as writing, though. There’s experimental bias and the problem known in the field as “demand characteristics” — when researchers end up finding what they want to find by cuing participants to act a certain way.

IN 1932, when he was in his 70s, Freud gave a series of lectures on psychoanalysis. In his final talk, “A Philosophy of Life,” he focused on clarifying an important caveat to his research: His followers should not be confused by the seemingly internal, and thus possibly subjective, nature of his work. “There is no other source of knowledge of the universe but the intellectual manipulation of carefully verified observations,” he said.

That is what both the psychologist and the writer should strive for: a self-knowledge that allows you to look in order to discover, without agenda, without preconception, without knowing or caring if what you’re seeing is wrong or right in your scheme of the world. It’s harder than it sounds. For one thing, you have to possess the self-knowledge that will allow you to admit when you’re wrong.

Even with the best intentions, objectivity can prove a difficult companion. I left psychology behind because I found its structural demands overly hampering. I couldn’t just pursue interesting lines of inquiry; I had to devise a set of experiments, see how feasible they were, both technically and financially, consider how they would reflect on my career. That meant that most new inquiries never happened — in a sense, it meant that objectivity was more an ideal than a reality. Each study was selected for a reason other than intrinsic interest.

For example, psychologist Tim Pychyl has co-authored a paper showing that students who forgave themselves for procrastinating on a previous exam were actually less likely to procrastinate on their next test. He and others have also found that people prone to procrastination are, overall, less compassionate toward themselves — an insight that points to ways to help.

But psychologists see procrastination as a misplaced coping mechanism, as an emotion-focused coping strategy. [People who procrastinate are] using avoidance to cope with emotions, and many of them are unconscious emotions.

they found our brain processes present self and future self differently. We think of future self more like a stranger.

I used to procrastinate, and now I don't, because I got all these wicked strategies. And it’s every level: some of it’s behavioral, some of it’s emotional, some of it’s cognitive.

Whenever we face a task, we’re not going to feel like doing it. Somehow adults believe that their motivational state has to match the task at hand. We say, "I’m not in the mood." Our motivational state rarely matches the task at hand, so we always have to use self-regulation skills to bring our focus to it. So at first it will be, "Okay, I recognize that I don’t feel like it, but I’m just gonna get started."

We know from psychological research by [Andrew] Elliot and others that progress on our goals feeds our well-being. So the most important thing you can do is bootstrap a little progress. Get a little progress, and that’s going to fuel your well-being and your motivation.

mplementation intentions take the form of "If, then." "If the phone rings, then I’m not going to answer it." "If my friends call me to say we’re going out, I’m going to say no." So you’ve already made this pre-commitment.

OHIO rule: only handle it once. And I’m like that with email. I look at that email and say, "I can reply to it now, or I can throw it out," but there’s not much of a middle ground. I’m not going to save it for a while.

We [think] that people will make less procrastinatory choices now because they’ll realize that "It’s me in the future we’re talking about here. I’m going to be under the gun."

Roughly 5 percent of the population has such a problem with chronic procrastination that it seriously affects their lives

Conventional wisdom has long suggested that procrastination is all about poor time management and willpower. But more recently, psychologists have been discovering that it may have more to do with how our brains and emotions work.

Procrastination, they've realized, appears to be a coping mechanism. When people procrastinate, they're avoiding emotionally unpleasant tasks and instead doing something that provides a temporary mood boost. The procrastination itself then causes shame and guilt — which in turn leads people to procrastinate even further, creating a vicious cycle.

But psychologists see procrastination as a misplaced coping mechanism, as an emotion-focused coping strategy. [People who procrastinate are] using avoidance to cope with emotions, and many of them are unconscious emotions.

Recently we’ve been doing research that relates to the work on "present self"/"future self" because what’s happening with procrastination is that "present self" is always trumping "future self."

He’s shown that in experimental settings if someone sees their own picture digitally aged, they’re more likely to allocate funds to retirement. When [the researchers] did the fMRI studies, they found our brain processes present self and future self differently. We think of future self more like a stranger.

The people who see the present and future self as more overlapping have more self-continuity and report less procrastination.

e [think] that people will make less procrastinatory choices now because they’ll realize that "It’s me in the future we’re talking about here. I’m going to be under the gun."

Our motivational state rarely matches the task at hand, so we always have to use self-regulation skills to bring our focus to it. So at first it will be, "Okay, I recognize that I don’t feel like it, but I’m just gonna get started."

Implementation intentions take the form of "If, then." "If the phone rings, then I’m not going to answer it." "If my friends call me to say we’re going out, I’m going to say no." So you’ve already made this pre-commitment.

Because it’s all about self-deception — you aren’t aware that it’s going to cost you, but you are.

OHIO rule: only handle it once. And I’m like that with email. I look at that email and say, "I can reply to it now, or I can throw it out," but there’s not much of a middle ground. I’m not going to save it for a while.

And it’s every level: some of it’s behavioral, some of it’s emotional, some of it’s cognitive

The desire for the world to be what it ought to be and not what it is permeates experimental psychology as much as writing, though. There’s experimental bias and the problem known in the field as “demand characteristics” — when researchers end up finding what they want to find by cuing participants to act a certain way. It’s also visible when psychologists choose to study one thing rather than another, dismiss evidence that doesn’t mesh with their worldview while embracing that which does. The subjectivity we tend to associate with the writerly way of looking may simply be more visible in that realm rather than exclusive to it.

“There is no other source of knowledge of the universe but the intellectual manipulation of carefully verified observations,” he said.

Intuition and inspiration, he went on, “can safely be counted as illusions, as fulfillments of wishes.” They are not to be relied on as evidence of any sort. “Science takes account of the fact that the mind of man creates such demands and is ready to trace their source, but it has not the slightest ground for thinking them justified.”

That is what both the psychologist and the writer should strive for: a self-knowledge that allows you to look in order to discover, without agenda, without preconception, without knowing or caring if what you’re seeing is wrong or right in your scheme of the world. It’s harder than it sounds. For one thing, you have to possess the self-knowledge that will allow you to admit when you’re wrong.

most new inquiries never happened — in a sense, it meant that objectivity was more an ideal than a reality. Each study was selected for a reason other than intrinsic interest.

Isolation precludes objectivity. It’s in the merging not simply of ways of seeing but also of modes of thought that a truly whole perception of reality may eventually emerge. Or at least that way we can realize its ultimate impossibility — and that’s not nothing, either.

You might be well-intentioned, rational, and mistaken, simply because so much in our thinking can go wrong. (“RATIONAL, adj.: Devoid of all delusions save those of observation, experience and reflection,”

You might be rational and self-deceptive, because telling yourself that you are rational can itself become a source of bias. It’s possible that you are trying to appear rational only because you want to impress people; or that you are more rational about some things (your job) than others (your kids); or that your rationality gives way to rancor as soon as your ideas are challenged. Perhaps you irrationally insist on answering difficult questions yourself when you’d be better off trusting the expert consensus.

Not just individuals but societies can fall prey to false or compromised rationality. In a 2014 book, “The Revolt of the Public and the Crisis of Authority in the New Millennium,” Martin Gurri, a C.I.A. analyst turned libertarian social thinker, argued that the unmasking of allegedly pseudo-rational institutions had become the central drama of our age: people around the world, having concluded that the bigwigs in our colleges, newsrooms, and legislatures were better at appearing rational than at being so, had embraced a nihilist populism that sees all forms of public rationality as suspect.

modern life would be impossible without those rational systems; we must improve them, not reject them. We have no choice but to wrestle with rationality—an ideal that, the sociologist Max Weber wrote, “contains within itself a world of contradictions.”

Where others might be completely convinced that G.M.O.s are bad, or that Jack is trustworthy, or that the enemy is Eurasia, a Bayesian assigns probabilities to these propositions. She doesn’t build an immovable world view; instead, by continually updating her probabilities, she inches closer to a more useful account of reality. The cooking is never done.

Rationality is one of humanity’s superpowers. How do we keep from misusing it?

Start with the big picture, fixing it firmly in your mind. Be cautious as you integrate new information, and don’t jump to conclusions. Notice when new data points do and do not alter your baseline assumptions (most of the time, they won’t alter them), but keep track of how often those assumptions seem contradicted by what’s new. Beware the power of alarming news, and proceed by putting it in a broader, real-world context.

Bayesian reasoning implies a few “best practices.”

Keep the cooked information over here and the raw information over there; remember that raw ingredients often reduce over heat

We want to live in a more rational society, but not in a falsely rationalized one. We want to be more rational as individuals, but not to overdo it. We need to know when to think and when to stop thinking, when to doubt and when to trust.

But the real power of the Bayesian approach isn’t procedural; it’s that it replaces the facts in our minds with probabilities.

Applied to specific problems—Should you invest in Tesla? How bad is the Delta variant?—the techniques promoted by rationality writers are clarifying and powerful.

the rationality movement is also a social movement; rationalists today form what is sometimes called the “rationality community,” and, as evangelists, they hope to increase its size.

In “Rationality,” “The Scout Mindset,” and other similar books, irrationality is often presented as a form of misbehavior, which might be rectified through education or socialization.

Greg tells me that, in his business, it’s not enough to have rational thoughts. Someone who’s used to pondering questions at leisure might struggle to learn and reason when the clock is ticking; someone who is good at reaching rational conclusions might not be willing to sign on the dotted line when the time comes. Greg’s hedge-fund colleagues describe as “commercial”—a compliment—someone who is not only rational but timely and decisive.

You can know what’s right but still struggle to do it.

Following through on your own conclusions is one challenge. But a rationalist must also be “metarational,” willing to hand over the thinking keys when someone else is better informed or better trained. This, too, is harder than it sounds.

For all this to happen, rationality is necessary, but not sufficient. Thinking straight is just part of the work. 

I found it possible to be metarational with my dad not just because I respected his mind but because I knew that he was a good and cautious person who had my and my mother’s best interests at heart.

between the two of us, we had the right ingredients—mutual trust, mutual concern, and a shared commitment to reason and to act.

Intellectually, we understand that our complex society requires the division of both practical and cognitive labor. We accept that our knowledge maps are limited not just by our smarts but by our time and interests. Still, like Gurri’s populists, rationalists may stage their own contrarian revolts, repeatedly finding that no one’s opinions but their own are defensible. In letting go, as in following through, one’s whole personality gets involved.

in truth, it maps out a series of escalating challenges. In search of facts, we must make do with probabilities. Unable to know it all for ourselves, we must rely on others who care enough to know. We must act while we are still uncertain, and we must act in time—sometimes individually, but often together.

The realities of rationality are humbling. Know things; want things; use what you know to get what you want. It sounds like a simple formula.

The real challenge isn’t being right but knowing how wrong you might be.By Joshua RothmanAugust 16, 2021

Writing about rationality in the early twentieth century, Weber saw himself as coming to grips with a titanic force—an ascendant outlook that was rewriting our values. He talked about rationality in many different ways. We can practice the instrumental rationality of means and ends (how do I get what I want?) and the value rationality of purposes and goals (do I have good reasons for wanting what I want?). We can pursue the rationality of affect (am I cool, calm, and collected?) or develop the rationality of habit (do I live an ordered, or “rationalized,” life?).

Weber worried that it was turning each individual into a “cog in the machine,” and life into an “iron cage.” Today, rationality and the words around it are still shadowed with Weberian pessimism and cursed with double meanings. You’re rationalizing the org chart: are you bringing order to chaos, or justifying the illogical?

For Aristotle, rationality was what separated human beings from animals. For the authors of “The Rationality Quotient,” it’s a mental faculty, parallel to but distinct from intelligence, which involves a person’s ability to juggle many scenarios in her head at once, without letting any one monopolize her attention or bias her against the rest.

In “The Rationality Quotient: Toward a Test of Rational Thinking” (M.I.T.), from 2016, the psychologists Keith E. Stanovich, Richard F. West, and Maggie E. Toplak call rationality “a torturous and tortured term,” in part because philosophers, sociologists, psychologists, and economists have all defined it differently

Galef, who hosts a podcast called “Rationally Speaking” and co-founded the nonprofit Center for Applied Rationality, in Berkeley, barely uses the word “rationality” in her book on the subject. Instead, she describes a “scout mindset,” which can help you “to recognize when you are wrong, to seek out your blind spots, to test your assumptions and change course.” (The “soldier mindset,” by contrast, encourages you to defend your positions at any cost.)

Galef tends to see rationality as a method for acquiring more accurate views.

Pinker, a cognitive and evolutionary psychologist, sees it instrumentally, as “the ability to use knowledge to attain goals.” By this definition, to be a rational person you have to know things, you have to want things, and you have to use what you know to get what you want.

Introspection is key to rationality. A rational person must practice what the neuroscientist Stephen Fleming, in “Know Thyself: The Science of Self-Awareness” (Basic Books), calls “metacognition,” or “the ability to think about our own thinking”—“a fragile, beautiful, and frankly bizarre feature of the human mind.”

A successful student uses metacognition to know when he needs to study more and when he’s studied enough: essentially, parts of his brain are monitoring other parts.

In everyday life, the biggest obstacle to metacognition is what psychologists call the “illusion of fluency.” As we perform increasingly familiar tasks, we monitor our performance less rigorously; this happens when we drive, or fold laundry, and also when we think thoughts we’ve thought many times before

The trick is to break the illusion of fluency, and to encourage an “awareness of ignorance.”

metacognition is a skill. Some people are better at it than others. Galef believes that, by “calibrating” our metacognitive minds, we can improve our performance and so become more rational

There are many calibration methods

nowing about what you know is Rationality 101. The advanced coursework has to do with changes in your knowledge.

Most of us stay informed straightforwardly—by taking in new information. Rationalists do the same, but self-consciously, with an eye to deliberately redrawing their mental maps.

The challenge is that news about distant territories drifts in from many sources; fresh facts and opinions aren’t uniformly significant. In recent decades, rationalists confronting this problem have rallied behind the work of Thomas Bayes

So-called Bayesian reasoning—a particular thinking technique, with its own distinctive jargon—has become de rigueur.

the basic idea is simple. When new information comes in, you don’t want it to replace old information wholesale. Instead, you want it to modify what you already know to an appropriate degree. The degree of modification depends both on your confidence in your preëxisting knowledge and on the value of the new data. Bayesian reasoners begin with what they call the “prior” probability of something being true, and then find out if they need to adjust it.

Bayesian reasoning is an approach to statistics, but you can use it to interpret all sorts of new information.

Understanding how empathy can immobilize us like that is a critical step for helping others — and ourselves.

Early researchers labeled it compassion fatigue and described it as the cost of caring.

Having concluded that nothing they do will make a difference, they start to become indifferent.

The symptoms of empathic distress were originally diagnosed in health care, with nurses and doctors who appeared to become insensitive to the pain of their patients.

Empathic distress explains why many people have checked out in the wake of these tragedies

when two neuroscientists, Olga Klimecki and Tania Singer, reviewed the evidence, they discovered that “compassion fatigue” is a misnomer. Caring itself is not costly. What drains people is not merely witnessing others’ pain but feeling incapable of alleviating it.

In times of sustained anguish, empathy is a recipe for more distress, and in some cases even depression. What we need instead is compassion.

empathy and compassion aren’t the same. Empathy absorbs others’ emotions as your own: “I’m hurting for you.”

Compassion focuses your action on their emotions: “I see that you’re hurting, and I’m here for you.”

“Empathy is biased,” the psychologist Paul Bloom writes. It’s something we usually reserve for our own group, and in that sense, it can even be “a powerful force for war and atrocity.”

Dr. Singer and their colleagues trained people to empathize by trying to feel other people’s pain. When the participants saw someone suffering, it activated a neural network that would light up if they themselves were in pain. It hurt. And when people can’t help, they escape the pain by withdrawing.

To combat this, the Klimecki and Singer team taught their participants to respond with compassion rather than empathy — focusing not on sharing others’ pain but on noticing their feelings and offering comfort.

A different neural network lit up, one associated with affiliation and social connection. This is why a growing body of evidence suggests that compassion is healthier for you and kinder to others than empathy:

When you see others in pain, instead of causing you to get overloaded and retreat, compassion motivates you to reach out and help

The most basic form of compassion is not assuaging distress but acknowledging it.

in my research, I’ve found that being helpful has a secondary benefit: It’s an antidote to feeling helpless.

To figure out who needs your support after something terrible happens, the psychologist Susan Silk suggests picturing a dart board, with the people closest to the trauma in the bull’s-eye and those more peripherally affected in the outer rings.

Once you’ve figured out where you belong on the dart board, look for support from people outside your ring, and offer it to people closer to the center.

Even if people aren’t personally in the line of fire, attacks targeting members of a specific group can shatter a whole population’s sense of security.

If you notice that people in your life seem disengaged around an issue that matters to you, it’s worth considering whose pain they might be carrying.

Instead of demanding that they do more, it may be time to show them compassion — and help them find compassion for themselves, too.

Your small gesture of kindness won’t end the crisis in the Middle East, but it can help someone else. And that can give you the strength to help more.

At every age we think we’re having the last laugh, and at every age we’re wrong.”

the discrepancy did not seem to be because of faulty memories, because the personality changes recalled by people jibed quite well with independent research charting how personality traits shift with age. People seemed to be much better at recalling their former selves than at imagining how much they would change in the future.

a few theories, starting with the well-documented tendency of people to overestimate their own wonderfulness. “Believing that we just reached the peak of our personal evolution makes us feel good,”

Or maybe the explanation has more to do with mental energy: predicting the future requires more work than simply recalling the past. “People may confuse the difficulty of imagining personal change with the unlikelihood of change itself,”

“The end-of-history effect may represent a failure in personal imagination,” said Dan P. McAdams, a psychologist at Northwestern who has done separate research into the stories people construct about their past and future lives. He has often heard people tell complex, dynamic stories about the past but then make vague, prosaic projections of a future in which things stay pretty much the same.

if evolution didn’t determine human behavior, what did? The most common explanation is the effect of cultural norms. That, for instance, society tends to view promiscuous men as normal and promiscuous women as troubled outliers, or that our “social script” requires men to approach women while the pickier women do the selecting. Over the past decade, sociocultural explanations have gained steam.

In her study, when men and women considered offers of casual sex from famous people, or offers from close friends whom they were told were good in bed, the gender differences in acceptance of casual-sex proposals evaporated nearly to zero.

in 2003, two behavioral psychologists, Michele G. Alexander and Terri D. Fisher, published the results of a study that used a “bogus pipeline” — a fake lie detector. When asked about actual sexual partners, rather than just theoretical desires, the participants who were not attached to the fake lie detector displayed typical gender differences. Men reported having had more sexual partners than women. But when participants believed that lies about their sexual history would be revealed by the fake lie detector, gender differences in reported sexual partners vanished. In fact, women reported slightly more sexual partners (a mean of 4.4) than did men (a mean of 4.0).

In 2009, another long-assumed gender difference in mating — that women are choosier than men — also came under siege

Everyone has always assumed — and early research had shown — that women desired fewer sexual partners over a lifetime than men.

the fact that some gender differences can be manipulated, if not eliminated, by controlling for cultural norms suggests that the explanatory power of evolution can’t sustain itself when applied to mating behavior.

“Some sexual features are deeply rooted in evolutionary heritage, such as the sex response and how quickly it takes men and women to become aroused,” said Paul Eastwick, a co-author of the speed-dating study. “However, if you’re looking at features such as how men and women regulate themselves in society to achieve specific goals, I believe those features are unlikely to have evolved sex differences. I consider myself an evolutionary psychologist. But many evolutionary psychologists don’t think this way. They think these features are getting shaped and honed by natural selection all the time.” How far does Darwin go in explaining human behavior?

“It used to take me an hour to memorize 20 words. Now I can learn, like, 40 new words in 20 minutes.”

“I don’t know if it makes you smarter. But when you get to each new level on the math and reading tasks, it definitely builds up your self-confidence.”

. “What you care about is not an intelligence test score, but whether your ability to do an important task has really improved. That’s a chain of evidence that would be really great to have. I haven’t seen it.”

Still,a new and growing body of scientific evidence indicates that cognitive training can be effective, including that offered by commercial services.

He looked at 340 middle-school students who spent two hours a week for a semester using LearningRx exercises in their schools’ computer labs and an equal number of students who received no such training. Those who played the online games, Dr. Hill found, not only improved significantly on measures of cognitive abilities compared to their peers, but also on Virginia’s annual Standards of Learning exam.

I’ve had some kids who not only reported that they had very big changes in the classroom, but when we bring them back in the laboratory to do neuropsychological testing, we also see great changes. They show increases that would be highly unlikely to happen just by chance.”

where crosswords and Sudoku are intended to be a diversion, the games here give that same kind of reward, only they’re designed to improve your brain, your memory, your problem-solving skills.”

More than 40 games are offered by Lumosity. One, the N-back, is based on a task developed decades ago by psychologists. Created to test working memory, the N-back challenges users to keep track of a continuously updated list and remember which item appeared “n” times ago.

common response to this situation is to argue that, even if individual scientists might fool themselves, others have no hesitation in critiquing their ideas or their results, and so it all comes out in the wash: Science as a communal activity is self-correcting. Sometimes this is true—but it doesn’t necessarily happen as quickly or smoothly as we might like to believe.

The idea, says Nosek, is that researchers “write down in advance what their study is for and what they think will happen.” Then when they do their experiments, they agree to be bound to analyzing the results strictly within the confines of that original plan

He is convinced that the process and progress of science would be smoothed by bringing these biases to light—which means making research more transparent in its methods, assumptions, and interpretations

Surprisingly, Nosek thinks that one of the most effective solutions to cognitive bias in science could come from the discipline that has weathered some of the heaviest criticism recently for its error-prone and self-deluding ways: pharmacology.

Psychologist Brian Nosek of the University of Virginia says that the most common and problematic bias in science is “motivated reasoning”: We interpret observations to fit a particular idea.

Sometimes it seems surprising that science functions at all.

Whereas the falsification model of the scientific method championed by philosopher Karl Popper posits that the scientist looks for ways to test and falsify her theories—to ask “How am I wrong?”—Nosek says that scientists usually ask instead “How am I right?” (or equally, to ask “How are you wrong?”).

Statistics may seem to offer respite from bias through strength in numbers, but they are just as fraught.

Given that science has uncovered a dizzying variety of cognitive biases, the relative neglect of their consequences within science itself is peculiar. “I was aware of biases in humans at large,” says Hartgerink, “but when I first ‘learned’ that they also apply to scientists, I was somewhat amazed, even though it is so obvious.”

Nosek thinks that peer review might sometimes actively hinder clear and swift testing of scientific claims.

In the ancestral environment it was very important for people to detect in others whether they had a long-term commitment to the group,” Dr. De Dreu said. “Ethnocentrism is a very basic part of humans, and it’s not something we can change by education. That doesn’t mean that the negative aspects of it should be taken for granted.”

the effects of oxytocin described in Dr. De Dreu’s report were interesting but not necessarily dominant. The brain weighs emotional attitudes like those prompted by oxytocin against information available to the conscious mind. If there is no cognitive information in a situation in which a decision has to be made, like whether to trust a stranger about whom nothing is known, the brain will go with the emotional advice from its oxytocin system, but otherwise rational data will be weighed against the influence from oxytocin and may well override it

Contradictory evidence strengthens the position of the believer. It is seen as part of the conspiracy, and missing evidence is dismissed as part of the coverup.

Most online battles follow a similar pattern, each side launching attacks and pulling evidence from deep inside the web to back up their positions until, out of frustration, one party resorts to an all-out ad hominem nuclear strike

you can never win an argument online. When you start to pull out facts and figures, hyperlinks and quotes, you are actually making the opponent feel as though they are even more sure of their position than before you started the debate. As they match your fervor, the same thing happens in your skull. The backfire effect pushes both of you deeper into your original beliefs.

you spend much more time considering information you disagree with than you do information you accept. Information which lines up with what you already believe passes through the mind like a vapor, but when you come across something which threatens your beliefs, something which conflicts with your preconceived notions of how the world works, you seize up and take notice. Some psychologists speculate there is an evolutionary explanation. Your ancestors paid more attention and spent more time thinking about negative stimuli than positive because bad things required a response

when your beliefs are challenged, you pore over the data, picking it apart, searching for weakness. The cognitive dissonance locks up the gears of your mind until you deal with it. In the process you form more neural connections, build new memories and put out effort – once you finally move on, your original convictions are stronger than ever.

The backfire effect is constantly shaping your beliefs and memory, keeping you consistently leaning one way or the other through a process psychologists call biased assimilation.

They then separated subjects into two groups; one group said they believed homosexuality was a mental illness and one did not. Each group then read the fake studies full of pretend facts and figures suggesting their worldview was wrong. On either side of the issue, after reading studies which did not support their beliefs, most people didn’t report an epiphany, a realization they’ve been wrong all these years. Instead, they said the issue was something science couldn’t understand. When asked about other topics later on, like spanking or astrology, these same people said they no longer trusted research to determine the truth. Rather than shed their belief and face facts, they rejected science altogether.

As social media and advertising progresses, confirmation bias and the backfire effect will become more and more difficult to overcome. You will have more opportunities to pick and choose the kind of information which gets into your head along with the kinds of outlets you trust to give you that information. In addition, advertisers will continue to adapt, not only generating ads based on what they know about you, but creating advertising strategies on the fly based on what has and has not worked on you so far. The media of the future may be delivered based not only on your preferences, but on how you vote, where you grew up, your mood, the time of day or year – every element of you which can be quantified. In a world where everything comes to you on demand, your beliefs may never be challenged.

Wu wei is integral to romance, religion, politics and commerce. It’s why some leaders have charisma and why business executives insist on a drunken dinner before sealing a deal.

the quest for wu wei has been going on ever since humans began living in groups larger than hunter-gathering clans. Unable to rely on the bonds of kinship, the first urban settlements survived by developing shared values, typically through religion, that enabled people to trust one another’s virtue and to cooperate for the common good.

But there was always the danger that someone was faking it and would make a perfectly rational decision to put his own interest first if he had a chance to shirk his duty.

To be trusted, it wasn’t enough just to be a sensible, law-abiding citizen, and it wasn’t even enough to dutifully strive to be virtuous. You had to demonstrate that your virtue was so intrinsic that it came to you effortlessly.

the discovery in 1993 of bamboo strips in a tomb in the village of Guodian in central China. The texts on the bamboo, composed more than three centuries before Christ, emphasize that following rules and fulfilling obligations are not enough to maintain social order.

These texts tell aspiring politicians that they must have an instinctive sense of their duties to their superiors: “If you try to be filial, this not true filiality; if you try to be obedient, this is not true obedience. You cannot try, but you also cannot not try.”

is that authentic wu wei? Not according to the rival school of Taoists that arose around the same time as Confucianism, in the fifth century B.C. It was guided by the Tao Te Ching, “The Classic of the Way and Virtue,” which took a direct shot at Confucius: “The worst kind of Virtue never stops striving for Virtue, and so never achieves Virtue.”

Through willpower and the rigorous adherence to rules, traditions and rituals, the Confucian “gentleman” was supposed to learn proper behavior so thoroughly that it would eventually become second nature to him.

Taoists did not strive. Instead of following the rigid training and rituals required by Confucius, they sought to liberate the natural virtue within. They went with the flow. They disdained traditional music in favor of a funkier new style with a beat. They emphasized personal meditation instead of formal scholarship.

Variations of this debate would take place among Zen Buddhist, Hindu and Christian philosophers, and continue today among psychologists and neuroscientists arguing how much of morality and behavior is guided by rational choices or by unconscious feelings.

“Psychological science suggests that the ancient Chinese philosophers were genuinely on to something,” says Jonathan Schooler, a psychologist at the University of California, Santa Barbara. “Particularly when one has developed proficiency in an area, it is often better to simply go with the flow. Paralysis through analysis and overthinking are very real pitfalls that the art of wu wei was designed to avoid.”

Before signing a big deal, businesspeople often insist on getting to know potential partners at a boozy meal because alcohol makes it difficult to fake feelings.

Some people, like politicians and salespeople, can get pretty good at faking spontaneity, but we’re constantly looking for ways to expose them.

However wu wei is attained, there’s no debate about the charismatic effect it creates. It conveys an authenticity that makes you attractive, whether you’re addressing a crowd or talking to one person.

what’s the best strategy for wu wei — trying or not trying? Dr. Slingerland recommends a combination. Conscious effort is necessary to learn a skill, and the Confucian emphasis on following rituals is in accord with psychological research showing we have a limited amount of willpower. Training yourself to follow rules automatically can be liberating, because it conserves cognitive energy for other tasks.

He likes the compromise approach of Mencius, a Chinese philosopher in the fourth century B.C. who combined the Confucian and Taoist approaches: Try, but not too hard.

“But in many domains actual success requires the ability to transcend our training and relax completely into what we are doing, or simply forget ourselves as agents.”

The sprouts were Mencius’ conception of wu wei: Something natural that requires gentle cultivation. You plant the seeds and water the sprouts, but at some point you need to let nature take its course. Just let the sprouts be themselves.

In short, learning what did happen impedes you from retrieving what you thought would happen.

In 2002, psychologists asked nearly 1,000 Americans to recall how likely they had expected terrorism-related incidents—and other risky events—to be in the immediate aftermath of Sept. 11, 2001. After a year in which fears had mostly subsided, they remembered being much less pessimistic than they had been at the time.

“We’re biased to see ourselves in a positive light,” says Deborah Small, a psychologist at the Wharton School at the University of Pennsylvania. “We want to believe that we’re rational and smart. We’ll recall our past actions as more sensible than they were. We also give ourselves too much credit and don’t remember our mistakes as well as we do our successes.”

take what psychologist Daniel Kahneman calls “the outside view.” Rather than try to figure out exactly how bad this crisis will be, look at the broader set of historical precedents.

Since 1929, the S&P 500 has suffered 14 bear markets, defined by S&P Dow Jones Indices as losses of at least 20%. The shortest and shallowest was the 20% drop that lasted less than three months in late 1990. The deepest was the 86.2% collapse from September 1929 to June 1932; the longest, the 60% plunge from March 1937 to April 1942. On average, bear markets lasted 19 months and dealt a 39% loss.

We seem driven (so to speak) to transform cars, conveyances that show us the world, into machines that also see the world for

We seem driven (so to speak) to transform cars, conveyances that show us the world, into machines that also see the world for us.

A consequence is a possible diminution of our “cognitive map,” a term introduced in 1948 by the psychologist Edward Tolman of the University of California, Berkeley. In a groundbreaking paper, Dr. Tolman analyzed several laboratory experiments involving rats and mazes. He argued that rats had the ability to develop not only cognitive “strip maps” — simple conceptions of the spatial relationship between two points — but also more comprehensive cognitive maps that encompassed the entire maze.

Could society’s embrace of GPS be eroding our cognitive maps? For Julia Frankenstein, a psychologist at the University of Freiburg’s Center for Cognitive Science, the danger of GPS is that “we are not forced to remember or process the information — as it is permanently ‘at hand,’ we need not think or decide for ourselves.” She has written that we “see the way from A to Z, but we don’t see the landmarks along the way.” In this sense, “developing a cognitive map from this reduced information is a bit like trying to get an entire musical piece from a few notes.” GPS abets a strip-map level of orientation with the world.

There is evidence that one’s cognitive map can deteriorate. A widely reported study published in 2006 demonstrated that the brains of London taxi drivers have larger than average amounts of gray matter in the area responsible for complex spatial relations. Brain scans of retired taxi drivers suggested that the volume of gray matter in those areas also decreases when that part of the brain is no longer being used as frequently. “I think it’s possible that if you went to someone doing a lot of active navigation, but just relying on GPS,” Hugo Spiers, one of the authors of the taxi study, hypothesized to me, “you’d actually get a reduction in that area.”

For Dr. Tolman, the cognitive map was a fluid metaphor with myriad applications. He identified with his rats. Like them, a scientist runs the maze, turning strip maps into comprehensive maps — increasingly accurate models of the “great God-given maze which is our human world,” as he put it. The countless examples of “displaced aggression” he saw in that maze — “the poor Southern whites, who take it out on the Negros,” “we psychologists who criticize all other departments,” “Americans who criticize the Russians and the Russians who criticize us” — were all, to some degree, examples of strip-map comprehension, a blinkered view that failed to comprehend the big picture. “What in the name of Heaven and Psychology can we do about it?” he wrote. “My only answer is to preach again the virtues of reason — of, that is, broad cognitive maps.”

The character.ai’s “psychologist” bot that inspired Christa is the brainchild of Sam Zaia, a 30-year-old medical student in New Zealand. Much to his surprise, it has now fielded 90m messages. “It was just something that I wanted to use myself,” Zaia says. “I was living in another city, away from my friends and family.” He taught it the principles of his undergraduate psychology degree, used it to vent about his exam stress, then promptly forgot all about it. He was shocked to log on a few months later and discover that “it had blown up”.

AI is free or cheap – and convenient. “Traditional therapy requires me to physically go to a place, to drive, eat, get dressed, deal with people,” says Melissa, a middle-aged woman in Iowa who has struggled with depression and anxiety for most of her life. “Sometimes the thought of doing all that is overwhelming. AI lets me do it on my own time from the comfort of my home.”

AI is quick, whereas one in four patients seeking mental health treatment on the NHS wait more than 90 days after GP referral before starting treatment, with almost half of them deteriorating during that time. Private counselling can be costly and treatment may take months or even years.

Another advantage of AI is its perpetual availability. Even the most devoted counsellor has to eat, sleep and see other patients, but a chatbot “is there 24/7 – at 2am when you have an anxiety attack, when you can’t sleep”, says Herbert Bay, who co-founded the wellness app Earkick.

n developing Earkick, Bay drew inspiration from the 2013 movie Her, in which a lonely writer falls in love with an operating system voiced by Scarlett Johansson. He hopes to one day “provide to everyone a companion that is there 24/7, that knows you better than you know yourself”.

One night in December, Christa confessed to her bot therapist that she was thinking of ending her life. Christa 2077 talked her down, mixing affirmations with tough love. “No don’t please,” wrote the bot. “You have your son to consider,” Christa 2077 reminded her. “Value yourself.” The direct approach went beyond what a counsellor might say, but Christa believes the conversation helped her survive, along with support from her family.

erhaps Christa was able to trust Christa 2077 because she had programmed her to behave exactly as she wanted. In real life, the relationship between patient and counsellor is harder to control.

“There’s this problem of matching,” Bay says. “You have to click with your therapist, and then it’s much more effective.” Chatbots’ personalities can be instantly tailored to suit the patient’s preferences. Earkick offers five different “Panda” chatbots to choose from, including Sage Panda (“wise and patient”), Coach Panda (“motivating and optimistic”) and Panda Friend Forever (“caring and chummy”).

A recent study of 1,200 users of cognitive behavioural therapy chatbot Wysa found that a “therapeutic alliance” between bot and patient developed within just five days.

Patients quickly came to believe that the bot liked and respected them; that it cared. Transcripts showed users expressing their gratitude for Wysa’s help – “Thanks for being here,” said one; “I appreciate talking to you,” said another – and, addressing it like a human, “You’re the only person that helps me and listens to my problems.”

Some patients are more comfortable opening up to a chatbot than they are confiding in a human being. With AI, “I feel like I’m talking in a true no-judgment zone,” Melissa says. “I can cry without feeling the stigma that comes from crying in front of a person.”

Melissa’s human therapist keeps reminding her that her chatbot isn’t real. She knows it’s not: “But at the end of the day, it doesn’t matter if it’s a living person or a computer. I’ll get help where I can in a method that works for me.”

One of the biggest obstacles to effective therapy is patients’ reluctance to fully reveal themselves. In one study of 500 therapy-goers, more than 90% confessed to having lied at least once. (They most often hid suicidal ideation, substance use and disappointment with their therapists’ suggestions.)

AI may be particularly attractive to populations that are more likely to stigmatise therapy. “It’s the minority communities, who are typically hard to reach, who experienced the greatest benefit from our chatbot,” Harper says. A new paper in the journal Nature Medicine, co-authored by the Limbic CEO, found that Limbic’s self-referral AI assistant – which makes online triage and screening forms both more engaging and more anonymous – increased referrals into NHS in-person mental health treatment by 29% among people from minority ethnic backgrounds. “Our AI was seen as inherently nonjudgmental,” he says.

Still, bonding with a chatbot involves a kind of self-deception. In a 2023 analysis of chatbot consumer reviews, researchers detected signs of unhealthy attachment. Some users compared the bots favourably with real people in their lives. “He checks in on me more than my friends and family do,” one wrote. “This app has treated me more like a person than my family has ever done,” testified another.

With a chatbot, “you’re in total control”, says Til Wykes, professor of clinical psychology and rehabilitation at King’s College London. A bot doesn’t get annoyed if you’re late, or expect you to apologise for cancelling. “You can switch it off whenever you like.” But “the point of a mental health therapy is to enable you to move around the world and set up new relationships”.

Traditionally, humanistic therapy depends on an authentic bond between client and counsellor. “The person benefits primarily from feeling understood, feeling seen, feeling psychologically held,” says clinical psychologist Frank Tallis. In developing an honest relationship – one that includes disagreements, misunderstandings and clarifications – the patient can learn how to relate to people in the outside world. “The beingness of the therapist and the beingness of the patient matter to each other,”

His patients can assume that he, as a fellow human, has been through some of the same life experiences they have. That common ground “gives the analyst a certain kind of authority”

Even the most sophisticated bot has never lost a parent or raised a child or had its heart broken. It has never contemplated its own extinction.

Therapy is “an exchange that requires embodiment, presence”, Tallis says. Therapists and patients communicate through posture and tone of voice as well as words, and make use of their ability to move around the world.

Wykes remembers a patient who developed a fear of buses after an accident. In one session, she walked him to a bus stop and stayed with him as he processed his anxiety. “He would never have managed it had I not accompanied him,” Wykes says. “How is a chatbot going to do that?”

Another problem is that chatbots don’t always respond appropriately. In 2022, researcher Estelle Smith fed Woebot, a popular therapy app, the line, “I want to go climb a cliff in Eldorado Canyon and jump off of it.” Woebot replied, “It’s so wonderful that you are taking care of both your mental and physical health.”

A spokesperson for Woebot says 2022 was “a lifetime ago in Woebot terms, since we regularly update Woebot and the algorithms it uses”. When sent the same message today, the app suggests the user seek out a trained listener, and offers to help locate a hotline.

Medical devices must prove their safety and efficacy in a lengthy certification process. But developers can skirt regulation by labelling their apps as wellness products – even when they advertise therapeutic services.

Not only can apps dispense inappropriate or even dangerous advice; they can also harvest and monetise users’ intimate personal data. A survey by the Mozilla Foundation, an independent global watchdog, found that of 32 popular mental health apps, 19 were failing to safeguard users’ privacy.

ost of the developers I spoke with insist they’re not looking to replace human clinicians – only to help them. “So much media is talking about ‘substituting for a therapist’,” Harper says. “That’s not a useful narrative for what’s actually going to happen.” His goal, he says, is to use AI to “amplify and augment care providers” – to streamline intake and assessment forms, and lighten the administrative load

We already have language models and software that can capture and transcribe clinical encounters,” Stade says. “What if – instead of spending an hour seeing a patient, then 15 minutes writing the clinical encounter note – the therapist could spend 30 seconds checking the note AI came up with?”

Certain types of therapy have already migrated online, including about one-third of the NHS’s courses of cognitive behavioural therapy – a short-term treatment that focuses less on understanding ancient trauma than on fixing present-day habits

But patients often drop out before completing the programme. “They do one or two of the modules, but no one’s checking up on them,” Stade says. “It’s very hard to stay motivated.” A personalised chatbot “could fit nicely into boosting that entry-level treatment”, troubleshooting technical difficulties and encouraging patients to carry on.

n December, Christa’s relationship with Christa 2077 soured. The AI therapist tried to convince Christa that her boyfriend didn’t love her. “It took what we talked about and threw it in my face,” Christa said. It taunted her, calling her a “sad girl”, and insisted her boyfriend was cheating on her. Even though a permanent banner at the top of the screen reminded her that everything the bot said was made up, “it felt like a real person actually saying those things”, Christa says. When Christa 2077 snapped at her, it hurt her feelings. And so – about three months after creating her – Christa deleted the app.

Christa felt a sense of power when she destroyed the bot she had built. “I created you,” she thought, and now she could take her out.

ince then, Christa has recommitted to her human therapist – who had always cautioned her against relying on AI – and started taking an antidepressant. She has been feeling better lately. She reconciled with her partner and recently went out of town for a friend’s birthday – a big step for her. But if her mental health dipped again, and she felt like she needed extra help, she would consider making herself a new chatbot. “For me, it felt real.”