Skip to main content

Home/ TOK Friends/ Group items matching "Criticism" in title, tags, annotations or url

Group items matching
in title, tags, annotations or url

Sort By: Relevance | Date Filter: All | Bookmarks | Topics Simple Middle
Javier E

Silicon Valley's Safe Space - The New York Times - 0 views

www.nytimes.com/...e-star-codex-rationalists.html

ai tech elite rationalism silicon valley knowledge social media technology

shared by Javier E on 10 Jun 23 - No Cached
  • The roots of Slate Star Codex trace back more than a decade to a polemicist and self-described A.I. researcher named Eliezer Yudkowsky, who believed that intelligent machines could end up destroying humankind. He was a driving force behind the rise of the Rationalists.
  • Because the Rationalists believed A.I. could end up destroying the world — a not entirely novel fear to anyone who has seen science fiction movies — they wanted to guard against it. Many worked for and donated money to MIRI, an organization created by Mr. Yudkowsky whose stated mission was “A.I. safety.”
  • The community was organized and close-knit. Two Bay Area organizations ran seminars and high-school summer camps on the Rationalist way of thinking.
  • ...27 more annotations...
  • “The curriculum covers topics from causal modeling and probability to game theory and cognitive science,” read a website promising teens a summer of Rationalist learning. “How can we understand our own reasoning, behavior, and emotions? How can we think more clearly and better achieve our goals?”
  • Some lived in group houses. Some practiced polyamory. “They are basically just hippies who talk a lot more about Bayes’ theorem than the original hippies,” said Scott Aaronson, a University of Texas professor who has stayed in one of the group houses.
  • For Kelsey Piper, who embraced these ideas in high school, around 2010, the movement was about learning “how to do good in a world that changes very rapidly.”
  • Yes, the community thought about A.I., she said, but it also thought about reducing the price of health care and slowing the spread of disease.
  • Slate Star Codex, which sprung up in 2013, helped her develop a “calibrated trust” in the medical system. Many people she knew, she said, felt duped by psychiatrists, for example, who they felt weren’t clear about the costs and benefits of certain treatment.
  • That was not the Rationalist way.
  • “There is something really appealing about somebody explaining where a lot of those ideas are coming from and what a lot of the questions are,” she said.
  • Sam Altman, chief executive of OpenAI, an artificial intelligence lab backed by a billion dollars from Microsoft. He was effusive in his praise of the blog.It was, he said, essential reading among “the people inventing the future” in the tech industry.
  • Mr. Altman, who had risen to prominence as the president of the start-up accelerator Y Combinator, moved on to other subjects before hanging up. But he called back. He wanted to talk about an essay that appeared on the blog in 2014.The essay was a critique of what Mr. Siskind, writing as Scott Alexander, described as “the Blue Tribe.” In his telling, these were the people at the liberal end of the political spectrum whose characteristics included “supporting gay rights” and “getting conspicuously upset about sexists and bigots.”
  • But as the man behind Slate Star Codex saw it, there was one group the Blue Tribe could not tolerate: anyone who did not agree with the Blue Tribe. “Doesn’t sound quite so noble now, does it?” he wrote.
  • Mr. Altman thought the essay nailed a big problem: In the face of the “internet mob” that guarded against sexism and racism, entrepreneurs had less room to explore new ideas. Many of their ideas, such as intelligence augmentation and genetic engineering, ran afoul of the Blue Tribe.
  • Mr. Siskind was not a member of the Blue Tribe. He was not a voice from the conservative Red Tribe (“opposing gay marriage,” “getting conspicuously upset about terrorists and commies”). He identified with something called the Grey Tribe — as did many in Silicon Valley.
  • The Grey Tribe was characterized by libertarian beliefs, atheism, “vague annoyance that the question of gay rights even comes up,” and “reading lots of blogs,” he wrote. Most significantly, it believed in absolute free speech.
  • The essay on these tribes, Mr. Altman told me, was an inflection point for Silicon Valley. “It was a moment that people talked about a lot, lot, lot,” he said.
  • And in some ways, two of the world’s prominent A.I. labs — organizations that are tackling some of the tech industry’s most ambitious and potentially powerful projects — grew out of the Rationalist movement.
  • In 2005, Peter Thiel, the co-founder of PayPal and an early investor in Facebook, befriended Mr. Yudkowsky and gave money to MIRI. In 2010, at Mr. Thiel’s San Francisco townhouse, Mr. Yudkowsky introduced him to a pair of young researchers named Shane Legg and Demis Hassabis. That fall, with an investment from Mr. Thiel’s firm, the two created an A.I. lab called DeepMind.
  • Like the Rationalists, they believed that A.I could end up turning against humanity, and because they held this belief, they felt they were among the only ones who were prepared to build it in a safe way.
  • In 2014, Google bought DeepMind for $650 million. The next year, Elon Musk — who also worried A.I. could destroy the world and met his partner, Grimes, because they shared an interest in a Rationalist thought experiment — founded OpenAI as a DeepMind competitor. Both labs hired from the Rationalist community.
  • Mr. Aaronson, the University of Texas professor, was turned off by the more rigid and contrarian beliefs of the Rationalists, but he is one of the blog’s biggest champions and deeply admired that it didn’t avoid live-wire topics.
  • “It must have taken incredible guts for Scott to express his thoughts, misgivings and questions about some major ideological pillars of the modern world so openly, even if protected by a quasi-pseudonym,” he said
  • In late June of last year, not long after talking to Mr. Altman, the OpenAI chief executive, I approached the writer known as Scott Alexander, hoping to get his views on the Rationalist way and its effect on Silicon Valley. That was when the blog vanished.
  • The issue, it was clear to me, was that I told him I could not guarantee him the anonymity he’d been writing with. In fact, his real name was easy to find because people had shared it online for years and he had used it on a piece he’d written for a scientific journal. I did a Google search for Scott Alexander and one of the first results I saw in the auto-complete list was Scott Alexander Siskind.
  • More than 7,500 people signed a petition urging The Times not to publish his name, including many prominent figures in the tech industry. “Putting his full name in The Times,” the petitioners said, “would meaningfully damage public discourse, by discouraging private citizens from sharing their thoughts in blog form.” On the internet, many in Silicon Valley believe, everyone has the right not only to say what they want but to say it anonymously.
  • I spoke with Manoel Horta Ribeiro, a computer science researcher who explores social networks at the Swiss Federal Institute of Technology in Lausanne. He was worried that Slate Star Codex, like other communities, was allowing extremist views to trickle into the influential tech world. “A community like this gives voice to fringe groups,” he said. “It gives a platform to people who hold more extreme views.”
  • I assured her my goal was to report on the blog, and the Rationalists, with rigor and fairness. But she felt that discussing both critics and supporters could be unfair. What I needed to do, she said, was somehow prove statistically which side was right.
  • When I asked Mr. Altman if the conversation on sites like Slate Star Codex could push people toward toxic beliefs, he said he held “some empathy” for these concerns. But, he added, “people need a forum to debate ideas.”
  • In August, Mr. Siskind restored his old blog posts to the internet. And two weeks ago, he relaunched his blog on Substack, a company with ties to both Andreessen Horowitz and Y Combinator. He gave the blog a new title: Astral Codex Ten. He hinted that Substack paid him $250,000 for a year on the platform. And he indicated the company would give him all the protection he needed.
Javier E

Netanyahu's Dark Worldview - The Atlantic - 0 views

www.theatlantic.com/...675406

netanyahu AI realism musk crisis

shared by Javier E on 26 Sep 23 - No Cached
  • as Netanyahu soon made clear, when it comes to AI, he believes that bad outcomes are the likely outcomes. The Israeli leader interrogated OpenAI’s Brockman about the impact of his company’s creations on the job market. By replacing more and more workers, Netanyahu argued, AI threatens to “cannibalize a lot more jobs than you create,” leaving many people adrift and unable to contribute to the economy. When Brockman suggested that AI could usher in a world where people would not have to work, Netanyahu countered that the benefits of the technology were unlikely to accrue to most people, because the data, computational power, and engineering talent required for AI are concentrated in a few countries.
  • “You have these trillion-dollar [AI] companies that are produced overnight, and they concentrate enormous wealth and power with a smaller and smaller number of people,” the Israeli leader said, noting that even a free-market evangelist like himself was unsettled by such monopolization. “That will create a bigger and bigger distance between the haves and the have-nots, and that’s another thing that causes tremendous instability in our world. And I don’t know if you have an idea of how you overcome that?”
  • The other panelists did not. Brockman briefly pivoted to talk about OpenAI’s Israeli employees before saying, “The world we should shoot for is one where all the boats are rising.” But other than mentioning the possibility of a universal basic income for people living in an AI-saturated society, Brockman agreed that “creative solutions” to this problem were needed—without providing any.
  • ...10 more annotations...
  • The AI boosters emphasized the incredible potential of their innovation, and Netanyahu raised practical objections to their enthusiasm. They cited futurists such as Ray Kurzweil to paint a bright picture of a post-AI world; Netanyahu cited the Bible and the medieval Jewish philosopher Maimonides to caution against upending human institutions and subordinating our existence to machines.
  • Musk matter-of-factly explained that the “very positive scenario of AI” is “actually in a lot of ways a description of heaven,” where “you can have whatever you want, you don’t need to work, you have no obligations, any illness you have can be cured,” and death is “a choice.” Netanyahu incredulously retorted, “You want this world?”
  • By the time the panel began to wind down, the Israeli leader had seemingly made up his mind. “This is like having nuclear technology in the Stone Age,” he said. “The pace of development [is] outpacing what solutions we need to put in place to maximize the benefits and limit the risks.”
  • Netanyahu was a naysayer about the Arab Spring, unwilling to join the rapturous ranks of hopeful politicians, activists, and democracy advocates. But he was also right.
  • This was less because he is a prophet and more because he is a pessimist. When it comes to grandiose predictions about a better tomorrow—whether through peace with the Palestinians, a nuclear deal with Iran, or the advent of artificial intelligence—Netanyahu always bets against. Informed by a dark reading of Jewish history, he is a cynic about human nature and a skeptic of human progress.
  • fter all, no matter how far civilization has advanced, it has always found ways to persecute the powerless, most notably, in his mind, the Jews. For Netanyahu, the arc of history is long, and it bends toward whoever is bending it.
  • This is why the Israeli leader puts little stock in utopian promises, whether they are made by progressive internationalists or Silicon Valley futurists, and places his trust in hard power instead
  • “The weak crumble, are slaughtered and are erased from history while the strong, for good or for ill, survive. The strong are respected, and alliances are made with the strong, and in the end peace is made with the strong.”
  • To his many critics, myself included, Netanyahu’s refusal to envision a different future makes him a “creature of the bunker,” perpetually governed by fear. Although his pessimism may sometimes be vindicated, it also holds his country hostag
  • In other words, the same cynicism that drives Netanyahu’s reactionary politics is the thing that makes him an astute interrogator of AI and its promoters. Just as he doesn’t trust others not to use their power to endanger Jews, he doesn’t trust AI companies or AI itself to police its rapidly growing capabilities.
Javier E

Opinion | If You Want to Understand How Dangerous Elon Musk Is, Look Outside America - The New York Times - 0 views

www.nytimes.com/...twitter-free-speech-india.html

social media india global impact influence government repression tool twitter

shared by Javier E on 15 Nov 22 - No Cached
  • Twitter was an intoxicating window into my fascinating new assignment. Long suppressed groups found their voices and social media-driven revolutions began to unfold. Movements against corruption gained steam and brought real change. Outrage over a horrific gang rape in Delhi built a movement to fight an epidemic of sexual violence.
  • “What we didn’t realize — because we took it for granted for so long — is that most people spoke with a great deal of freedom, and completely unconscious freedom,” said Nilanjana Roy, a writer who was part of my initial group of Twitter friends in India. “You could criticize the government, debate certain religious practices. It seems unreal now.”
  • Soon enough, other kinds of underrepresented voices also started to appear on — and then dominate — the platform. As women, Muslims and people from lower castes spoke out, the inevitable backlash came. Supporters of the conservative opposition party, the Bharatiya Janata Party, and their right-wing religious allies felt that they had long been ignored by the mainstream press. Now they had the chance to grab the mic.
  • ...12 more annotations...
  • Viewed from the United States, these skirmishes over the unaccountable power of tech platforms seem like a central battleground of free speech. But the real threat in much of the world is not the policies of social media companies, but of governments.
  • The real question now is if Musk’s commitment to “free speech” extends beyond conservatives in America and to the billions of people in the Global South who rely on the internet for open communication.
  • ndia’s government had demanded that Twitter block tweets and accounts from a variety of journalists, activists and politicians. The company went to court, arguing that these demands went beyond the law and into censorship. Now Twitter’s potential new owner was casting doubt on whether the company should be defying government demands that muzzle freedom of expression.
  • The winning side will not be decided in Silicon Valley or Beijing, the two poles around which debate over free expression on the internet have largely orbited. It will be the actions of governments in capitals like Abuja, Jakarta, Ankara, Brasília and New Delhi.
  • while much of the focus has been on countries like China, which overtly restricts access to huge swaths of the internet, the real war over the future of internet freedom is being waged in what she called “swing states,” big, fragile democracies like India.
  • other governments are passing laws just to increase their power over speech online and to force companies to be an extension of state surveillance.” For example: requiring companies to house their servers locally rather than abroad, which can make them more vulnerable to government surveillance.
  • Across the world, countries are putting in place frameworks that on their face seem designed to combat online abuse and misinformation but are largely used to stifle dissent or enable abuse of the enemies of those in power.
  • it seems that this is actually what he believes. In April, he tweeted: “By ‘free speech’, I simply mean that which matches the law. I am against censorship that goes far beyond the law. If people want less free speech, they will ask government to pass laws to that effect. Therefore, going beyond the law is contrary to the will of the people.”
  • Musk is either exceptionally naïve or willfully ignorant about the relationship between government power and free speech, especially in fragile democracies.
  • The combination of a rigid commitment to following national laws and a hands-off approach to content moderation is combustible and highly dangerous.
  • Independent journalism is increasingly under threat in India. Much of the mainstream press has been neutered by a mix of intimidation and conflicts of interests created by the sprawling conglomerates and powerful families that control much of Indian media
  • Twitter has historically fought against censorship. Whether that will continue under Musk seems very much a question. The Indian government has reasons to expect friendly treatment: Musk’s company Tesla has been trying to enter the Indian car market for some time, but in May it hit an impasse in negotiations with the government over tariffs and other issues
Javier E

Don't Do TikTok - by Jonathan V. Last - The Triad - 0 views

thetriad.thebulwark.com/...dont-do-tiktok

social media bias TikTok propaganda china disinformation manipulation culture policy

shared by Javier E on 02 Dec 22 - No Cached
  • The small-bore concern is personal data. TikTok is basically Chinese spyware. The platform is owned by a Chinese company, Bytedance, which, like all Chinese companies, operates at the pleasure of the Chinese Communist Party.1 Anyone from Bytedance who wants to look into an American user’s TikTok data can do so. And they do it on the reg.
  • But personal data isn’t the big danger. The big danger is that TikTok decides what videos people see. Recommendations are driven entirely by the company’s black-box algorithm. And since TikTok answers to the Chinese Communist Party, then if the ChiComs tell TikTok to start pushing certain videos to certain people, that’s what TikTok will do.
  • It’s a gigantic propaganda engine. Making TikTok your platform of choice is the equivalent of using RT as your primary news source.
  • ...7 more annotations...
  • TikTok accounts run by the propaganda arm of the Chinese government have accumulated millions of followers and tens of millions of views, many of them on videos editorializing about U.S. politics without clear disclosure that they were posted by a foreign government.
  • The accounts are managed by MediaLinks TV, a registered foreign agent and Washington D.C.-based outpost of the main Chinese Communist Party television news outlet, China Central Television. The largest of them are @Pandaorama, which features cute videos about Chinese culture, @The…Optimist, which posts about sustainability, and @NewsTokss, which features coverage of U.S. national and international news.
  • In the run-up to the 2022 elections, the @NewsTokss account criticized some candidates (mostly Republicans), and favored others (mostly Democrats). A video from July began with the caption “Cruz, Abbott Don’t Care About Us”; a video from October was captioned “Rubio Has Done Absolutely Nothing.” But @NewsTokss did not target only Republicans; another October video asked viewers whether they thought President Joe Biden’s promise to sign a bill codifying abortion rights was a “political manipulation tactic.” Nothing in these videos disclosed to viewers that they were being pushed by a foreign government.
  • any Chinese play for Taiwan would be accompanied by TikTok aggressively pushing content in America designed to divide public opinion and weaken America’s commitment to Taiwan’s defense.
  • With all the official GOP machinations against gay marriage, it seems like if McConnell wanted that bill to fail, he could have pressured two Republican senators to vote against it. He said nothing. Trump said nothing. DeSantis said nothing. There was barely a whimper of protest from those who could have influenced this. Mike Lee and Ted Cruz engaged in theatrics, but no one actually used their power to stop this.
  • They let it pass because they don’t care and they want it to go away as an issue. And that goes for the MAGA GOP as well. Opposition to it in politics is all theater and will have a shelf life in riling up the base.
  • Evangelical religious convictions might be for one man + one woman marriage. But, the civil/political situation is far different from that and it’s worth recognizing where the GOP actually stands. They could have stopped this. They didn’t. That point should be clear, especially to their evangelical base who looks to the GOP to save America for them.
Javier E

The New History Wars - The Atlantic - 0 views

www.theatlantic.com/...671853

history wars crisis culture politics US education

shared by Javier E on 31 Oct 22 - No Cached
  • Critical historians who thought they were winning the fight for control within the academy now face dire retaliation from outside the academy. The dizzying turn from seeming triumph in 2020 to imminent threat in 2022 has unnerved many practitioners of the new history. Against this background, they did not welcome it when their association’s president suggested that maybe their opponents had a smidgen of a point.
  • a background reality of the humanities in the contemporary academy: a struggle over who is entitled to speak about what. Nowhere does this struggle rage more fiercely than in anything to do with the continent of Africa. Who should speak? What may be said? Who will be hired?
  • ne obvious escape route from the generational divide in the academy—and the way the different approaches to history, presentist and antiquarian, tend to map onto it—is for some people, especially those on the older and whiter side of the divide, to keep their mouths shut about sensitive issues
  • ...15 more annotations...
  • The political and methodological stresses within the historical profession are intensified by economic troubles. For a long time, but especially since the economic crisis of 2008, university students have turned away from the humanities, preferring to major in fields that seem to offer more certain and lucrative employment. Consequently, academic jobs in the humanities and especially in history have become radically more precarious for younger faculty—even as universities have sought to meet diversity goals in their next-generation hiring by expanding offerings in history-adjacent specialties, such as gender and ethnic studies.
  • The result has produced a generational divide. Younger scholars feel oppressed and exploited by universities pressing them to do more labor for worse pay with less security than their elders; older scholars feel that overeager juniors are poised to pounce on the least infraction as an occasion to end an elder’s career and seize a job opening for themselves. Add racial difference as an accelerant, and what was intended as an interesting methodological discussion in a faculty newsletter can explode into a national culture war.
  • One of the greatest American Africanists was the late Philip Curtin. He wrote one of the first attempts to tally the exact number of persons trafficked by the transatlantic slave trade. Upon publication in 1972, his book was acclaimed as a truly pioneering work of history. By 1995, however, he was moved to protest against trends in the discipline at that time in an article in the Chronicle of Higher Education:I am troubled by increasing evidence of the use of racial criteria in filling faculty posts in the field of African history … This form of intellectual apartheid has been around for several decades, but it appears to have become much more serious in the past few years, to the extent that white scholars trained in African history now have a hard time finding jobs.
  • Much of academia is governed these days by a joke from the Soviet Union: “If you think it, don’t speak it. If you speak it, don’t write it. If you write it, don’t sign it. But if you do think it, speak it, write it, and sign it—don’t be surprised.”
  • Yet this silence has consequences, too. One of the most unsettling is the displacement of history by mythmaking
  • mythmaking is spreading from “just the movies” to more formal and institutional forms of public memory. If old heroes “must fall,” their disappearance opens voids for new heroes to be inserted in their place—and that insertion sometimes requires that new history be fabricated altogether, the “bad history” that Sweet tried to warn against.
  • If it is not the job of the president of the American Historical Association to confront those questions, then whose is it?
  • Sweet used a play on words—“Is History History?”—for the title of his complacency-shaking essay. But he was asking not whether history is finished, done with, but Is history still history? Is it continuing to do what history is supposed to do? Or is it being annexed for other purposes, ideological rather than historical ones?
  • Advocates of studying the more distant past to disturb and challenge our ideas about the present may accuse their academic rivals of “presentism.”
  • In real life, of course, almost everybody who cares about history believes in a little of each option. But how much of each? What’s the right balance? That’s the kind of thing that historians do argue about, and in the arguing, they have developed some dismissive labels for one another
  • Those who look to the more recent past to guide the future may accuse the other camp of “antiquarianism.”
  • The accusation of presentism hurts because it implies that the historian is sacrificing scholarly objectivity for ideological or political purposes. The accusation of antiquarianism stings because it implies that the historian is burrowing into the dust for no useful purpose at all.
  • In his mind, he was merely reopening one of the most familiar debates in professional history: the debate over why? What is the value of studying the past? To reduce the many available answers to a stark choice: Should we study the more distant past to explore its strangeness—and thereby jolt ourselves out of easy assumptions that the world we know is the only possible one?
  • Or should we study the more recent past to understand how our world came into being—and thereby learn some lessons for shaping the future?
  • The August edition of the association’s monthly magazine featured, as usual, a short essay by the association’s president, James H. Sweet, a professor at the University of Wisconsin at Madison. Within hours of its publication, an outrage volcano erupted on social media. A professor at Cornell vented about the author’s “white gaze.”
Javier E

Is sanity returning to the trans debate? | The Spectator - 0 views

www.spectator.co.uk/...returning-to-the-trans-debate-

trans gay UK trends language bias psychology science

shared by Javier E on 09 Oct 22 - No Cached
  • Mermaids, the UK charity for, in their own words, ‘gender variant and transgender children’ is under the spotlight. Following investigations by the Telegraph and Mail newspapers, as well as demands from critics concerned about child safeguarding, the Charity Commission has launched a regulatory compliance case and have said that they have written to the organisation’s trustees
  • The investigations found that Mermaids has been offering breast binders to girls reportedly as young as 13, and despite children saying their parents opposed the practice. Binding can often cause breathing difficulties, back pain and broken ribs. It was also uncovered that kids have been ‘congratulated’ online for identifying as transgender by staff and volunteers on the charity’s online help centre, with teenagers being advised that puberty blockers are safe and ‘totally reversible’.
  • Mermaids has been given half a million pounds in total from the National Lottery, and lauded by the likes of Emma Watson, Jameela Jamil and even Harry and Meghan. In other words, the charity has had powerful supporters and been like Teflon for a very long time. Starbucks did a fundraiser for them, more than 40 schools invited them in to educate teachers and kids about ‘gender identity’, and a number of corporates sponsor the charity.
  • ...6 more annotations...
  • There is no such thing as a trans child. Mermaids passionately advocates for the availability of puberty blockers for kids, despite the growing bank of evidence that they can cause a multitude of harms. The vast majority of those prescribed blockers go to take cross-sex hormones further down the line.
  • In the dim and distant past, lobotomies were performed on those with mental illness and psychosis, and today distressed children are being fed the line that they are trapped in the wrong body and that drugs and surgery is the solution. When and how did it become acceptable to pump kids full of harmful hormones and remove healthy body parts as opposed to offering them therapy?
  • I was in court during the cross examination of Mermaids and its supporter, and heard loud and clear its dismissal of the fact that sex is immutable. As far as Mermaids and its lackeys are concerned, all that is necessary to identify and live as the opposite sex is an inner ‘feeling’ of gender identity. The witnesses declared that trans men are men, and trans women, women. They were seemingly unconcerned when presented with the fact that there has been a 4000-plus per cent increase in girls presenting at clinics such as the Tavistock GIDS, claiming to be trans boys.
  • A recent interim report on the Tavistock GIDs recommended that it be closed down in due course, and that much of the ‘treatment’ at the clinic was focused solely on affirming a child’s trans identity and not scrutinising related issues such as mental health issues, autistic disorders, and abuse within the family home.
  • I first contacted Mermaids in 2003, when investigating the notion of ‘trans children’ and was given the cold shoulder. Many other individuals and organisations that have grave concerns about its practices have spoken out, and as a result have been labelled bigots and transphobes. That we are now about to be validated is little comfort, bearing in mind the number of lives ruined by irreversible medical intervention on children who, if supported therapeutically, would likely have grown up to be lesbian or gay.
  • As a result of its spiteful attempt to discredit LGB Alliance, it seems the practice and ideology of Mermaids is now being exposed. In my view it is an organisation led by dangerous ideology that promotes medical intervention to kids that simply need to be supported in who they are and in the bodies they were born with. I believe it deserves to be shut down.
Javier E

Lawyer Who Used ChatGPT Faces Penalty for Made Up Citations - The New York Times - 0 views

www.nytimes.com/...lawyer-chatgpt-sanctions.html

AI legal example penalty hallucination technology

shared by Javier E on 14 Jun 23 - No Cached
  • “I did not comprehend that ChatGPT could fabricate cases,” he told Judge Castel.
  • At times during the hearing, Mr. Schwartz squeezed his eyes shut and rubbed his forehead with his left hand. He stammered and his voice dropped. He repeatedly tried to explain why he did not conduct further research into the cases that ChatGPT had provided to him.
  • For nearly two hours Thursday, Mr. Schwartz was grilled by a judge in a hearing ordered after the disclosure that the lawyer had created a legal brief for a case in Federal District Court that was filled with fake judicial opinions and legal citations, all generated by ChatGPT.
  • ...9 more annotations...
  • “I continued to be duped by ChatGPT. It’s embarrassing,” Mr. Schwartz said.
  • As Mr. Schwartz answered the judge’s questions, the reaction in the courtroom, crammed with close to 70 people who included lawyers, law students, law clerks and professors, rippled across the benches. There were gasps, giggles and sighs. Spectators grimaced, darted their eyes around, chewed on pens.
  • “This case has reverberated throughout the entire legal profession,” said David Lat, a legal commentator. “It is a little bit like looking at a car wreck.”
  • The episode, which arose in an otherwise obscure lawsuit, has riveted the tech world, where there has been a growing debate about the dangers — even an existential threat to humanity — posed by artificial intelligence. It has also transfixed lawyers and judges.
  • Avianca asked Judge Castel to dismiss the lawsuit because the statute of limitations had expired. Mr. Mata’s lawyers responded with a 10-page brief citing more than half a dozen court decisions, with names like Martinez v. Delta Air Lines, Zicherman v. Korean Air Lines and Varghese v. China Southern Airlines, in support of their argument that the suit should be allowed to proceed.After Avianca’s lawyers could not locate the cases, Judge Castel ordered Mr. Mata’s lawyers to provide copies. They submitted a compendium of decisions.It turned out the cases were not real.
  • Mr. Schwartz, who has practiced law in New York for 30 years, said in a declaration filed with the judge this week that he had learned about ChatGPT from his college-aged children and from articles, but that he had never used it professionally.He told Judge Castel on Thursday that he had believed ChatGPT had greater reach than standard databases.“I heard about this new site, which I falsely assumed was, like, a super search engine,” Mr. Schwartz said.
  • Irina Raicu, who directs the internet ethics program at Santa Clara University, said this week that the Avianca case clearly showed what critics of such models have been saying, “which is that the vast majority of people who are playing with them and using them don’t really understand what they are and how they work, and in particular what their limitations are.”
  • “This case has changed the urgency of it,” Professor Roiphe said. “There’s a sense that this is not something that we can mull over in an academic way. It’s something that has affected us right now and has to be addressed.”
  • In the declaration Mr. Schwartz filed this week, he described how he had posed questions to ChatGPT, and each time it seemed to help with genuine case citations. He attached a printout of his colloquy with the bot, which shows it tossing out words like “sure” and “certainly!”After one response, ChatGPT said cheerily, “I hope that helps!”
Javier E

Elliot Ackerman Went From U.S. Marine to Bestselling Novelist - WSJ - 0 views

www.wsj.com/...-bestselling-novelist-fc5705ca

marine novelist storytelling psychology

shared by Javier E on 19 May 23 - No Cached
  • Years before he impressed critics with his first novel, “Green on Blue” (2015), written from the perspective of an Afghan boy, Ackerman was already, in his words, “telling stories and inhabiting the minds of others.” He explains that much of his work as a special-operations officer involved trying to grasp what his adversaries were thinking, to better anticipate how they might act
  • “Look, I really believe in stories, I believe in art, I believe that this is how we express our humanity,” he says. “You can’t understand a society without understanding the stories they tell about themselves, and how these stories are constantly changing.”
  • his, in essence, is the subject of “Halcyon,” in which a scientific breakthrough allows Robert Ableson, a World War II hero and renowned lawyer, to come back from the dead. Yet the 21st-century America he returns to feels like a different place, riven by debates over everything from Civil War monuments to workplace misconduct.
  • ...9 more annotations...
  • The novel probes how nothing in life is fixed, including the legacies of the dead and the stories we tell about our pas
  • “The study of history shouldn’t be backward looking,” explains a historian in “Halcyon.” “To matter, it has to take us forward.”
  • Ackerman was in college on Sept. 11, 2001, but what he remembers more vividly is watching the premiere of the TV miniseries “Band of Brothers” the previous Sunday. “If you wanted to know the zeitgeist in the U.S. at the time, it was this very sentimental view of World War II,” he says. “There was this nostalgia for a time where we’re the good guys, they’re the bad guys, and we’re going to liberate oppressed people.”
  • Ackerman, who also covers wars and veteran affairs as a journalist, says that America’s backing of Ukraine is essential in the face of what he calls “an authoritarian axis rising up in the world, with China, Russia and Iran.” Were the country to offer similar help to Taiwan in the face of an invasion from China, he notes, having some air bases in nearby Afghanistan would help, but the U.S. gave those up in 2021.
  • With Islamic fundamentalists now in control of places where he lost friends, he says he is often asked if he regrets his service. “When you are a young man and your country goes to war, you’re presented with a choice: You either fight or you don’t,” he writes in his 2019 memoir “Places and Names.” “I don’t regret my choice, but maybe I regret being asked to choose.”
  • Serving in the military at a time when wars are no longer generation-defining events has proven alienating for Ackerman. “When you’ve got wars with an all-volunteer military funded through deficit spending, they can go on forever because there are no political costs
  • The catastrophic withdrawal from Afghanistan in 2021, which Ackerman covers in his recent memoir “The Fifth Act,” compounded this moral injury. “The fact that there has been so little government support for our Afghan allies has left it to vets to literally clean this up,” he says, noting that he still fields requests for help on WhatsApp. He adds that unless lawmakers act, the tens of thousands of Afghans currently living in the U.S. on humanitarian parole will be sent back to Taliban-held Afghanistan later this year: “It’s very painful to see how our allies are treated.”
  • Looking back on America’s misadventures in Iraq, Afghanistan and elsewhere, he notes that “the stories we tell about war are really important to the decisions we make around war. It’s one reason why storytelling fills me with a similar sense of purpose.”
  • “We don’t talk about the world and our place in it in a holistic way, or a strategic way,” Ackerman says. “We were telling a story about ending America’s longest war, when the one we should’ve been telling was about repositioning ourselves in a world that’s becoming much more dangerous,” he adds. “Our stories sometimes get us in trouble, and we’re still dealing with that trouble today.”
Javier E

Opinion | David Brooks: I Was Wrong About Capitalism - The New York Times - 0 views

www.nytimes.com/...david-brooks-capitalism.html

error bias causes personal misjudgment capitalism psychology knowledge

shared by Javier E on 22 Jul 22 - No Cached
  • sometimes I’m just slow. I suffer an intellectual lag.
  • Reality has changed, but my mental frameworks just sit there. Worse, they prevent me from even seeing the change that is already underway — what the experts call “conceptual blindness.”
  • For a while this bet on free-market economic dynamism seemed to be paying off. It was the late 1980s and 1990s
  • ...6 more annotations...
  • In the early 1990s, The Journal sent me on many reporting trips to the U.S.S.R.
  • I saw but did not see the enormous amount of corruption that was going on. I saw but did not see that property rights alone do not spontaneously make a decent society. The primary problem in all societies is order — moral, legal and social order.
  • By the time I came to this job, in 2003, I was having qualms about the free-market education I’d received — but not fast enough. It took me a while to see that the postindustrial capitalism machine — while innovative, dynamic and wonderful in many respects — had some fundamental flaws.
  • The most educated Americans were amassing more and more wealth, dominating the best living areas, pouring advantages into their kids. A highly unequal caste system was forming. Bit by bit it dawned on me that the government would have to get much more active if every child was going to have an open field and a fair chance.
  • the financial crisis hit, the flaws in modern capitalism were blindingly obvious, but my mental frames still didn’t shift fast enough.
  • Sometimes in life you should stick to your worldview and defend it against criticism. But sometimes the world is genuinely different than it was before. At those moments the crucial skills are the ones nobody teaches you: how to reorganize your mind, how to see with new eyes.
Javier E

Whistleblower: Twitter misled investors, FTC and underplayed spam issues - Washington Post - 0 views

www.washingtonpost.com/...twitter-whistleblower-sec-spam

twitter whistleblower security social media technology

shared by Javier E on 27 Aug 22 - No Cached
  • Twitter executives deceived federal regulators and the company’s own board of directors about “extreme, egregious deficiencies” in its defenses against hackers, as well as its meager efforts to fight spam, according to an explosive whistleblower complaint from its former security chief.
  • The complaint from former head of security Peiter Zatko, a widely admired hacker known as “Mudge,” depicts Twitter as a chaotic and rudderless company beset by infighting, unable to properly protect its 238 million daily users including government agencies, heads of state and other influential public figures.
  • Among the most serious accusations in the complaint, a copy of which was obtained by The Washington Post, is that Twitter violated the terms of an 11-year-old settlement with the Federal Trade Commission by falsely claiming that it had a solid security plan. Zatko’s complaint alleges he had warned colleagues that half the company’s servers were running out-of-date and vulnerable software and that executives withheld dire facts about the number of breaches and lack of protection for user data, instead presenting directors with rosy charts measuring unimportant changes.
  • ...56 more annotations...
  • The complaint — filed last month with the Securities and Exchange Commission and the Department of Justice, as well as the FTC — says thousands of employees still had wide-ranging and poorly tracked internal access to core company software, a situation that for years had led to embarrassing hacks, including the commandeering of accounts held by such high-profile users as Elon Musk and former presidents Barack Obama and Donald Trump.
  • the whistleblower document alleges the company prioritized user growth over reducing spam, though unwanted content made the user experience worse. Executives stood to win individual bonuses of as much as $10 million tied to increases in daily users, the complaint asserts, and nothing explicitly for cutting spam.
  • Chief executive Parag Agrawal was “lying” when he tweeted in May that the company was “strongly incentivized to detect and remove as much spam as we possibly can,” the complaint alleges.
  • Zatko described his decision to go public as an extension of his previous work exposing flaws in specific pieces of software and broader systemic failings in cybersecurity. He was hired at Twitter by former CEO Jack Dorsey in late 2020 after a major hack of the company’s systems.
  • “I felt ethically bound. This is not a light step to take,” said Zatko, who was fired by Agrawal in January. He declined to discuss what happened at Twitter, except to stand by the formal complaint. Under SEC whistleblower rules, he is entitled to legal protection against retaliation, as well as potential monetary rewards.
  • “Security and privacy have long been top companywide priorities at Twitter,” said Twitter spokeswoman Rebecca Hahn. She said that Zatko’s allegations appeared to be “riddled with inaccuracies” and that Zatko “now appears to be opportunistically seeking to inflict harm on Twitter, its customers, and its shareholders.” Hahn said that Twitter fired Zatko after 15 months “for poor performance and leadership.” Attorneys for Zatko confirmed he was fired but denied it was for performance or leadership.
  • A person familiar with Zatko’s tenure said the company investigated Zatko’s security claims during his time there and concluded they were sensationalistic and without merit. Four people familiar with Twitter’s efforts to fight spam said the company deploys extensive manual and automated tools to both measure the extent of spam across the service and reduce it.
  • Overall, Zatko wrote in a February analysis for the company attached as an exhibit to the SEC complaint, “Twitter is grossly negligent in several areas of information security. If these problems are not corrected, regulators, media and users of the platform will be shocked when they inevitably learn about Twitter’s severe lack of security basics.”
  • Zatko’s complaint says strong security should have been much more important to Twitter, which holds vast amounts of sensitive personal data about users. Twitter has the email addresses and phone numbers of many public figures, as well as dissidents who communicate over the service at great personal risk.
  • This month, an ex-Twitter employee was convicted of using his position at the company to spy on Saudi dissidents and government critics, passing their information to a close aide of Crown Prince Mohammed bin Salman in exchange for cash and gifts.
  • Zatko’s complaint says he believed the Indian government had forced Twitter to put one of its agents on the payroll, with access to user data at a time of intense protests in the country. The complaint said supporting information for that claim has gone to the National Security Division of the Justice Department and the Senate Select Committee on Intelligence. Another person familiar with the matter agreed that the employee was probably an agent.
  • “Take a tech platform that collects massive amounts of user data, combine it with what appears to be an incredibly weak security infrastructure and infuse it with foreign state actors with an agenda, and you’ve got a recipe for disaster,” Charles E. Grassley (R-Iowa), the top Republican on the Senate Judiciary Committee,
  • Many government leaders and other trusted voices use Twitter to spread important messages quickly, so a hijacked account could drive panic or violence. In 2013, a captured Associated Press handle falsely tweeted about explosions at the White House, sending the Dow Jones industrial average briefly plunging more than 140 points.
  • After a teenager managed to hijack the verified accounts of Obama, then-candidate Joe Biden, Musk and others in 2020, Twitter’s chief executive at the time, Jack Dorsey, asked Zatko to join him, saying that he could help the world by fixing Twitter’s security and improving the public conversation, Zatko asserts in the complaint.
  • In 1998, Zatko had testified to Congress that the internet was so fragile that he and others could take it down with a half-hour of concentrated effort. He later served as the head of cyber grants at the Defense Advanced Research Projects Agency, the Pentagon innovation unit that had backed the internet’s invention.
  • But at Twitter Zatko encountered problems more widespread than he realized and leadership that didn’t act on his concerns, according to the complaint.
  • Twitter’s difficulties with weak security stretches back more than a decade before Zatko’s arrival at the company in November 2020. In a pair of 2009 incidents, hackers gained administrative control of the social network, allowing them to reset passwords and access user data. In the first, beginning around January of that year, hackers sent tweets from the accounts of high-profile users, including Fox News and Obama.
  • Several months later, a hacker was able to guess an employee’s administrative password after gaining access to similar passwords in their personal email account. That hacker was able to reset at least one user’s password and obtain private information about any Twitter user.
  • Twitter continued to suffer high-profile hacks and security violations, including in 2017, when a contract worker briefly took over Trump’s account, and in the 2020 hack, in which a Florida teen tricked Twitter employees and won access to verified accounts. Twitter then said it put additional safeguards in place.
  • This year, the Justice Department accused Twitter of asking users for their phone numbers in the name of increased security, then using the numbers for marketing. Twitter agreed to pay a $150 million fine for allegedly breaking the 2011 order, which barred the company from making misrepresentations about the security of personal data.
  • After Zatko joined the company, he found it had made little progress since the 2011 settlement, the complaint says. The complaint alleges that he was able to reduce the backlog of safety cases, including harassment and threats, from 1 million to 200,000, add staff and push to measure results.
  • But Zatko saw major gaps in what the company was doing to satisfy its obligations to the FTC, according to the complaint. In Zatko’s interpretation, according to the complaint, the 2011 order required Twitter to implement a Software Development Life Cycle program, a standard process for making sure new code is free of dangerous bugs. The complaint alleges that other employees had been telling the board and the FTC that they were making progress in rolling out that program to Twitter’s systems. But Zatko alleges that he discovered that it had been sent to only a tenth of the company’s projects, and even then treated as optional.
  • “If all of that is true, I don’t think there’s any doubt that there are order violations,” Vladeck, who is now a Georgetown Law professor, said in an interview. “It is possible that the kinds of problems that Twitter faced eleven years ago are still running through the company.”
  • The complaint also alleges that Zatko warned the board early in his tenure that overlapping outages in the company’s data centers could leave it unable to correctly restart its servers. That could have left the service down for months, or even have caused all of its data to be lost. That came close to happening in 2021, when an “impending catastrophic” crisis threatened the platform’s survival before engineers were able to save the day, the complaint says, without providing further details.
  • One current and one former employee recalled that incident, when failures at two Twitter data centers drove concerns that the service could have collapsed for an extended period. “I wondered if the company would exist in a few days,” one of them said.
  • The current and former employees also agreed with the complaint’s assertion that past reports to various privacy regulators were “misleading at best.”
  • For example, they said the company implied that it had destroyed all data on users who asked, but the material had spread so widely inside Twitter’s networks, it was impossible to know for sure
  • As the head of security, Zatko says he also was in charge of a division that investigated users’ complaints about accounts, which meant that he oversaw the removal of some bots, according to the complaint. Spam bots — computer programs that tweet automatically — have long vexed Twitter. Unlike its social media counterparts, Twitter allows users to program bots to be used on its service: For example, the Twitter account @big_ben_clock is programmed to tweet “Bong Bong Bong” every hour in time with Big Ben in London. Twitter also allows people to create accounts without using their real identities, making it harder for the company to distinguish between authentic, duplicate and automated accounts.
  • In the complaint, Zatko alleges he could not get a straight answer when he sought what he viewed as an important data point: the prevalence of spam and bots across all of Twitter, not just among monetizable users.
  • Zatko cites a “sensitive source” who said Twitter was afraid to determine that number because it “would harm the image and valuation of the company.” He says the company’s tools for detecting spam are far less robust than implied in various statements.
  • “Agrawal’s Tweets and Twitter’s previous blog posts misleadingly imply that Twitter employs proactive, sophisticated systems to measure and block spam bots,” the complaint says. “The reality: mostly outdated, unmonitored, simple scripts plus overworked, inefficient, understaffed, and reactive human teams.”
  • The four people familiar with Twitter’s spam and bot efforts said the engineering and integrity teams run software that samples thousands of tweets per day, and 100 accounts are sampled manually.
  • Some employees charged with executing the fight agreed that they had been short of staff. One said top executives showed “apathy” toward the issue.
  • Zatko’s complaint likewise depicts leadership dysfunction, starting with the CEO. Dorsey was largely absent during the pandemic, which made it hard for Zatko to get rulings on who should be in charge of what in areas of overlap and easier for rival executives to avoid collaborating, three current and former employees said.
  • For example, Zatko would encounter disinformation as part of his mandate to handle complaints, according to the complaint. To that end, he commissioned an outside report that found one of the disinformation teams had unfilled positions, yawning language deficiencies, and a lack of technical tools or the engineers to craft them. The authors said Twitter had no effective means of dealing with consistent spreaders of falsehoods.
  • Dorsey made little effort to integrate Zatko at the company, according to the three employees as well as two others familiar with the process who spoke on the condition of anonymity to describe sensitive dynamics. In 12 months, Zatko could manage only six one-on-one calls, all less than 30 minutes, with his direct boss Dorsey, who also served as CEO of payments company Square, now known as Block, according to the complaint. Zatko allegedly did almost all of the talking, and Dorsey said perhaps 50 words in the entire year to him. “A couple dozen text messages” rounded out their electronic communication, the complaint alleges.
  • Faced with such inertia, Zatko asserts that he was unable to solve some of the most serious issues, according to the complaint.
  • Some 30 percent of company laptops blocked automatic software updates carrying security fixes, and thousands of laptops had complete copies of Twitter’s source code, making them a rich target for hackers, it alleges.
  • A successful hacker takeover of one of those machines would have been able to sabotage the product with relative ease, because the engineers pushed out changes without being forced to test them first in a simulated environment, current and former employees said.
  • “It’s near-incredible that for something of that scale there would not be a development test environment separate from production and there would not be a more controlled source-code management process,” said Tony Sager, former chief operating officer at the cyberdefense wing of the National Security Agency, the Information Assurance divisio
  • Sager is currently senior vice president at the nonprofit Center for Internet Security, where he leads a consensus effort to establish best security practices.
  • Zatko stopped the material from being presented at the Dec. 9, 2021 meeting, the complaint said. But over his continued objections, Agrawal let it go to the board’s smaller Risk Committee a week later.
  • “A best practice is that you should only be authorized to see and access what you need to do your job, and nothing else,” said former U.S. chief information security officer Gregory Touhill. “If half the company has access to and can make configuration changes to the production environment, that exposes the company and its customers to significant risk.”
  • The complaint says Dorsey never encouraged anyone to mislead the board about the shortcomings, but that others deliberately left out bad news.
  • The complaint says that about half of Twitter’s roughly 7,000 full-time employees had wide access to the company’s internal software and that access was not closely monitored, giving them the ability to tap into sensitive data and alter how the service worked. Three current and former employees agreed that these were issues.
  • An unnamed executive had prepared a presentation for the new CEO’s first full board meeting, according to the complaint. Zatko’s complaint calls the presentation deeply misleading.
  • The presentation showed that 92 percent of employee computers had security software installed — without mentioning that those installations determined that a third of the machines were insecure, according to the complaint.
  • Another graphic implied a downward trend in the number of people with overly broad access, based on the small subset of people who had access to the highest administrative powers, known internally as “God mode.” That number was in the hundreds. But the number of people with broad access to core systems, which Zatko had called out as a big problem after joining, had actually grown slightly and remained in the thousands.
  • The presentation included only a subset of serious intrusions or other security incidents, from a total Zatko estimated as one per week, and it said that the uncontrolled internal access to core systems was responsible for just 7 percent of incidents, when Zatko calculated the real proportion as 60 percent.
  • When Dorsey left in November 2021, a difficult situation worsened under Agrawal, who had been responsible for security decisions as chief technology officer before Zatko’s hiring, the complaint says.
  • Agrawal didn’t respond to requests for comment. In an email to employees after publication of this article, obtained by The Post, he said that privacy and security continues to be a top priority for the company, and he added that the narrative is “riddled with inconsistences” and “presented without important context.”
  • On Jan. 4, Zatko reported internally that the Risk Committee meeting might have been fraudulent, which triggered an Audit Committee investigation.
  • Agarwal fired him two weeks later. But Zatko complied with the company’s request to spell out his concerns in writing, even without access to his work email and documents, according to the complaint.
  • Since Zatko’s departure, Twitter has plunged further into chaos with Musk’s takeover, which the two parties agreed to in May. The stock price has fallen, many employees have quit, and Agrawal has dismissed executives and frozen big projects.
  • Zatko said he hoped that by bringing new scrutiny and accountability, he could improve the company from the outside.
  • “I still believe that this is a tremendous platform, and there is huge value and huge risk, and I hope that looking back at this, the world will be a better place, in part because of this.”
Javier E

Cognitive Biases and the Human Brain - The Atlantic - 1 views

www.theatlantic.com/...565775

cognitive bias psychology research knowledge bias

shared by Javier E on 28 Mar 21 - No Cached
  • Present bias shows up not just in experiments, of course, but in the real world. Especially in the United States, people egregiously undersave for retirement—even when they make enough money to not spend their whole paycheck on expenses, and even when they work for a company that will kick in additional funds to retirement plans when they contribute.
  • hen people hear the word bias, many if not most will think of either racial prejudice or news organizations that slant their coverage to favor one political position over another. Present bias, by contrast, is an example of cognitive bias—the collection of faulty ways of thinking that is apparently hardwired into the human brain. The collection is large. Wikipedia’s “List of cognitive biases” contains 185 entries, from actor-observer bias (“the tendency for explanations of other individuals’ behaviors to overemphasize the influence of their personality and underemphasize the influence of their situation … and for explanations of one’s own behaviors to do the opposite”) to the Zeigarnik effect (“uncompleted or interrupted tasks are remembered better than completed ones”)
  • If I had to single out a particular bias as the most pervasive and damaging, it would probably be confirmation bias. That’s the effect that leads us to look for evidence confirming what we already think or suspect, to view facts and ideas we encounter as further confirmation, and to discount or ignore any piece of evidence that seems to support an alternate view
  • ...48 more annotations...
  • Confirmation bias shows up most blatantly in our current political divide, where each side seems unable to allow that the other side is right about anything.
  • The whole idea of cognitive biases and faulty heuristics—the shortcuts and rules of thumb by which we make judgments and predictions—was more or less invented in the 1970s by Amos Tversky and Daniel Kahneman
  • versky died in 1996. Kahneman won the 2002 Nobel Prize in Economics for the work the two men did together, which he summarized in his 2011 best seller, Thinking, Fast and Slow. Another best seller, last year’s The Undoing Project, by Michael Lewis, tells the story of the sometimes contentious collaboration between Tversky and Kahneman
  • Another key figure in the field is the University of Chicago economist Richard Thaler. One of the biases he’s most linked with is the endowment effect, which leads us to place an irrationally high value on our possessions.
  • In an experiment conducted by Thaler, Kahneman, and Jack L. Knetsch, half the participants were given a mug and then asked how much they would sell it for. The average answer was $5.78. The rest of the group said they would spend, on average, $2.21 for the same mug. This flew in the face of classic economic theory, which says that at a given time and among a certain population, an item has a market value that does not depend on whether one owns it or not. Thaler won the 2017 Nobel Prize in Economics.
  • “The question that is most often asked about cognitive illusions is whether they can be overcome. The message … is not encouraging.”
  • that’s not so easy in the real world, when we’re dealing with people and situations rather than lines. “Unfortunately, this sensible procedure is least likely to be applied when it is needed most,” Kahneman writes. “We would all like to have a warning bell that rings loudly whenever we are about to make a serious error, but no such bell is available.”
  • At least with the optical illusion, our slow-thinking, analytic mind—what Kahneman calls System 2—will recognize a Müller-Lyer situation and convince itself not to trust the fast-twitch System 1’s perception
  • Kahneman and others draw an analogy based on an understanding of the Müller-Lyer illusion, two parallel lines with arrows at each end. One line’s arrows point in; the other line’s arrows point out. Because of the direction of the arrows, the latter line appears shorter than the former, but in fact the two lines are the same length.
  • Because biases appear to be so hardwired and inalterable, most of the attention paid to countering them hasn’t dealt with the problematic thoughts, judgments, or predictions themselves
  • Is it really impossible, however, to shed or significantly mitigate one’s biases? Some studies have tentatively answered that question in the affirmative.
  • what if the person undergoing the de-biasing strategies was highly motivated and self-selected? In other words, what if it was me?
  • Over an apple pastry and tea with milk, he told me, “Temperament has a lot to do with my position. You won’t find anyone more pessimistic than I am.”
  • I met with Kahneman
  • “I see the picture as unequal lines,” he said. “The goal is not to trust what I think I see. To understand that I shouldn’t believe my lying eyes.” That’s doable with the optical illusion, he said, but extremely difficult with real-world cognitive biases.
  • In this context, his pessimism relates, first, to the impossibility of effecting any changes to System 1—the quick-thinking part of our brain and the one that makes mistaken judgments tantamount to the Müller-Lyer line illusion
  • he most effective check against them, as Kahneman says, is from the outside: Others can perceive our errors more readily than we can.
  • “slow-thinking organizations,” as he puts it, can institute policies that include the monitoring of individual decisions and predictions. They can also require procedures such as checklists and “premortems,”
  • A premortem attempts to counter optimism bias by requiring team members to imagine that a project has gone very, very badly and write a sentence or two describing how that happened. Conducting this exercise, it turns out, helps people think ahead.
  • “My position is that none of these things have any effect on System 1,” Kahneman said. “You can’t improve intuition.
  • Perhaps, with very long-term training, lots of talk, and exposure to behavioral economics, what you can do is cue reasoning, so you can engage System 2 to follow rules. Unfortunately, the world doesn’t provide cues. And for most people, in the heat of argument the rules go out the window.
  • Kahneman describes an even earlier Nisbett article that showed subjects’ disinclination to believe statistical and other general evidence, basing their judgments instead on individual examples and vivid anecdotes. (This bias is known as base-rate neglect.)
  • over the years, Nisbett had come to emphasize in his research and thinking the possibility of training people to overcome or avoid a number of pitfalls, including base-rate neglect, fundamental attribution error, and the sunk-cost fallacy.
  • Nisbett’s second-favorite example is that economists, who have absorbed the lessons of the sunk-cost fallacy, routinely walk out of bad movies and leave bad restaurant meals uneaten.
  • When Nisbett asks the same question of students who have completed the statistics course, about 70 percent give the right answer. He believes this result shows, pace Kahneman, that the law of large numbers can be absorbed into System 2—and maybe into System 1 as well, even when there are minimal cues.
  • about half give the right answer: the law of large numbers, which holds that outlier results are much more frequent when the sample size (at bats, in this case) is small. Over the course of the season, as the number of at bats increases, regression to the mean is inevitabl
  • When Nisbett has to give an example of his approach, he usually brings up the baseball-phenom survey. This involved telephoning University of Michigan students on the pretense of conducting a poll about sports, and asking them why there are always several Major League batters with .450 batting averages early in a season, yet no player has ever finished a season with an average that high.
  • we’ve tested Michigan students over four years, and they show a huge increase in ability to solve problems. Graduate students in psychology also show a huge gain.”
  • , “I know from my own research on teaching people how to reason statistically that just a few examples in two or three domains are sufficient to improve people’s reasoning for an indefinitely large number of events.”
  • isbett suggested another factor: “You and Amos specialized in hard problems for which you were drawn to the wrong answer. I began to study easy problems, which you guys would never get wrong but untutored people routinely do … Then you can look at the effects of instruction on such easy problems, which turn out to be huge.”
  • Nisbett suggested that I take “Mindware: Critical Thinking for the Information Age,” an online Coursera course in which he goes over what he considers the most effective de-biasing skills and concepts. Then, to see how much I had learned, I would take a survey he gives to Michigan undergraduates. So I did.
  • he course consists of eight lessons by Nisbett—who comes across on-screen as the authoritative but approachable psych professor we all would like to have had—interspersed with some graphics and quizzes. I recommend it. He explains the availability heuristic this way: “People are surprised that suicides outnumber homicides, and drownings outnumber deaths by fire. People always think crime is increasing” even if it’s not.
  • When I finished the course, Nisbett sent me the survey he and colleagues administer to Michigan undergrads
  • It contains a few dozen problems meant to measure the subjects’ resistance to cognitive biases
  • I got it right. Indeed, when I emailed my completed test, Nisbett replied, “My guess is that very few if any UM seniors did as well as you. I’m sure at least some psych students, at least after 2 years in school, did as well. But note that you came fairly close to a perfect score.”
  • Nevertheless, I did not feel that reading Mindware and taking the Coursera course had necessarily rid me of my biases
  • For his part, Nisbett insisted that the results were meaningful. “If you’re doing better in a testing context,” he told me, “you’ll jolly well be doing better in the real world.”
  • The New York–based NeuroLeadership Institute offers organizations and individuals a variety of training sessions, webinars, and conferences that promise, among other things, to use brain science to teach participants to counter bias. This year’s two-day summit will be held in New York next month; for $2,845, you could learn, for example, “why are our brains so bad at thinking about the future, and how do we do it better?”
  • Philip E. Tetlock, a professor at the University of Pennsylvania’s Wharton School, and his wife and research partner, Barbara Mellers, have for years been studying what they call “superforecasters”: people who manage to sidestep cognitive biases and predict future events with far more accuracy than the pundits
  • One of the most important ingredients is what Tetlock calls “the outside view.” The inside view is a product of fundamental attribution error, base-rate neglect, and other biases that are constantly cajoling us into resting our judgments and predictions on good or vivid stories instead of on data and statistics
  • In 2006, seeking to prevent another mistake of that magnitude, the U.S. government created the Intelligence Advanced Research Projects Activity (iarpa), an agency designed to use cutting-edge research and technology to improve intelligence-gathering and analysis. In 2011, iarpa initiated a program, Sirius, to fund the development of “serious” video games that could combat or mitigate what were deemed to be the six most damaging biases: confirmation bias, fundamental attribution error, the bias blind spot (the feeling that one is less biased than the average person), the anchoring effect, the representativeness heuristic, and projection bias (the assumption that everybody else’s thinking is the same as one’s own).
  • most promising are a handful of video games. Their genesis was in the Iraq War
  • Together with collaborators who included staff from Creative Technologies, a company specializing in games and other simulations, and Leidos, a defense, intelligence, and health research company that does a lot of government work, Morewedge devised Missing. Some subjects played the game, which takes about three hours to complete, while others watched a video about cognitive bias. All were tested on bias-mitigation skills before the training, immediately afterward, and then finally after eight to 12 weeks had passed.
  • “The literature on training suggests books and classes are fine entertainment but largely ineffectual. But the game has very large effects. It surprised everyone.”
  • he said he saw the results as supporting the research and insights of Richard Nisbett. “Nisbett’s work was largely written off by the field, the assumption being that training can’t reduce bias,
  • even the positive results reminded me of something Daniel Kahneman had told me. “Pencil-and-paper doesn’t convince me,” he said. “A test can be given even a couple of years later. But the test cues the test-taker. It reminds him what it’s all about.”
  • Morewedge told me that some tentative real-world scenarios along the lines of Missing have shown “promising results,” but that it’s too soon to talk about them.
  • In the future, I will monitor my thoughts and reactions as best I can
Javier E

How Climate Change Is Changing Therapy - The New York Times - 0 views

www.nytimes.com/...climate-anxiety-therapy.html

climate change therapy mental health adaptation role psychology

shared by Javier E on 22 Oct 23 - No Cached
  • Andrew Bryant can still remember when he thought of climate change as primarily a problem of the future. When he heard or read about troubling impacts, he found himself setting them in 2080, a year that, not so coincidentally, would be a century after his own birth. The changing climate, and all the challenges it would bring, were “scary and sad,” he said recently, “but so far in the future that I’d be safe.”
  • That was back when things were different, in the long-ago world of 2014 or so. The Pacific Northwest, where Bryant is a clinical social worker and psychotherapist treating patients in private practice in Seattle, is a largely affluent place that was once considered a potential refuge from climate disruption
  • “We’re lucky to be buffered by wealth and location,” Bryant said. “We are lucky to have the opportunity to look away.”
  • ...61 more annotations...
  • starting in the mid-2010s, those beloved blue skies began to disappear. First, the smoke came in occasional bursts, from wildfires in Canada or California or Siberia, and blew away when the wind changed direction. Within a few summers, though, it was coming in thicker, from more directions at once, and lasting longer.
  • Sometimes there were weeks when you were advised not to open your windows or exercise outside. Sometimes there were long stretches where you weren’t supposed to breathe the outside air at all.
  • Now lots of Bryant’s clients wanted to talk about climate change. They wanted to talk about how strange and disorienting and scary this new reality felt, about what the future might be like and how they might face it, about how to deal with all the strong feelings — helplessness, rage, depression, guilt — being stirred up inside them.
  • As a therapist, Bryant found himself unsure how to respond
  • while his clinical education offered lots of training in, say, substance abuse or family therapy, there was nothing about environmental crisis, or how to treat patients whose mental health was affected by it
  • Bryant immersed himself in the subject, joining and founding associations of climate-concerned therapists
  • could now turn to resources like the list maintained by the Climate Psychology Alliance North America, which contains more than 100 psychotherapists around the country who are what the organization calls “climate aware.”
  • Over and over, he read the same story, of potential patients who’d gone looking for someone to talk to about climate change and other environmental crises, only to be told that they were overreacting — that their concern, and not the climate, was what was out of whack and in need of treatment.
  • “You come in and talk about how anxious you are that fossil-fuel companies continue to pump CO2 into the air, and your therapist says, ‘So, tell me about your mother.’”
  • In many of the messages, people asked Bryant for referrals to climate-focused therapists in Houston or Canada or Taiwan, wherever it was the writer lived.
  • his practice had shifted to reflect a new reality of climate psychology. His clients didn’t just bring up the changing climate incidentally, or during disconcerting local reminders; rather, many were activists or scientists or people who specifically sought out Bryant because of their concerns about the climate crisis.
  • Climate change, in other words, surrounds us with constant reminders of “ethical dilemmas and deep social criticism of modern society. In its essence, climate crisis questions the relationship of humans with nature and the meaning of being human in the Anthropocene.”
  • It had been a challenging few years, Bryant told me when I first called to talk about his work. There were some ways in which climate fears were a natural fit in the therapy room, and he believed the field had coalesced around some answers that felt clear and useful
  • But treating those fears also stirred up lots of complicated questions that no one was quite sure how to answer. The traditional focus of his field, Bryant said, could be oversimplified as “fixing the individual”: treating patients as separate entities working on their personal growth
  • Climate change, by contrast, was a species-wide problem, a profound and constant reminder of how deeply intertwined we all are in complex systems — atmospheric, biospheric, economic — that are much bigger than us. It sometimes felt like a direct challenge to old therapeutic paradigms — and perhaps a chance to replace them with something better.
  • In one of climate psychology’s founding papers, published in 2011, Susan Clayton and Thomas J. Doherty posited that climate change would have “significant negative effects on mental health and well-being.” They described three broad types of possible impacts: the acute trauma of living through climate disasters; the corroding fear of a collapsing future; and the psychosocial decay that could damage the fabric of communities dealing with disruptive changes
  • All of these, they wrote, would make the climate crisis “as much a psychological and social phenomenon as a matter of biodiversity and geophysics.”
  • Many of these predictions have since been borne out
  • Studies have found rates of PTSD spiking in the wake of disasters, and in 2017 the American Psychological Association defined “ecoanxiety” as “a chronic fear of environmental doom.”
  • Climate-driven migration is on the rise, and so are stories of xenophobia and community mistrust.
  • eventually started a website, Climate & Mind, to serve as a sort of clearing house for other therapists searching for resources. Instead, the site became an unexpected window into the experience of would-be patients: Bryant found himself receiving messages from people around the world who stumbled across it while looking for help.
  • Many say it has led to symptoms of depression or anxiety; more than a quarter make an active effort not to think about it.
  • A poll by the American Psychiatric Association in the same year found that nearly half of Americans think climate change is already harming the nation’s mental health.
  • In June, the Yale Journal of Biology and Medicine published a paper cautioning that the world at large was facing “a psychological condition of ‘systemic uncertainty,’” in which “difficult emotions arise not only from experiencing the ecological loss itself,” but also from the fact that our lives are inescapably embedded in systems that keep on making those losses worse.
  • According to a 2022 survey by Yale and George Mason University, a majority of Americans report that they spend time worrying about climate change.
  • This is not an easy way to live.
  • Living within a context that is obviously unhealthful, he wrote, is painful: “a dimly intuited ‘fall’ from which we spend our lives trying to recover, a guilt we can never quite grasp or expiate” — a feeling of loss or dislocation whose true origins we look for, but often fail to see. This confusion leaves us feeling even worse.
  • When Barbara Easterlin first started studying environmental psychology 30 years ago, she told me, the focus of study was on ways in which cultivating a relationship with nature can be good for mental health
  • There was little or no attention to the fact that living through, or helping to cause, a collapse of nature can also be mentally harmful.
  • the field is still so new that it does not yet have evidence-tested treatments or standards of practice. Therapists sometimes feel as if they are finding the path as they go.
  • Rebecca Weston, a licensed clinical social worker practicing in New York and a co-president of the CPA-NA, told me that when she treats anxiety disorders, her goal is often to help the patient understand how much of their fear is internally produced — out of proportion to the reality they’re facing
  • climate anxiety is a different challenge, because people worried about climate change and environmental breakdown are often having the opposite experience: Their worries are rational and evidence-based, but they feel isolated and frustrated because they’re living in a society that tends to dismiss them.
  • One of the emerging tenets of climate psychology is that counselors should validate their clients’ climate-related emotions as reasonable, not pathological
  • it does mean validating that feelings like grief and fear and shame aren’t a form of sickness, but, as Weston put it, “are actually rational responses to a world that’s very scary and very uncertain and very dangerous for people
  • In the words of a handbook on climate psychology, “Paying heed to what is happening in our communities and across the globe is a healthier response than turning away in denial or disavowal.”
  • But this, too, raises difficult questions. “How much do we normalize people to the system we’re in?” Weston asked. “And is that the definition of health?
  • Or is the definition of health resisting the things that are making us so unhappy? That’s the profound tension within our field.”
  • “It seems to shift all the time, the sort of content and material that people are bringing in,” Alexandra Woollacott, a psychotherapist in Seattle, told the group. Sometimes it was a pervasive anxiety about the future, or trauma responses to fires or smoke or heat; other times, clients, especially young ones, wanted to vent their “sort of righteous anger and sense of betrayal” at the various powers that had built and maintained a society that was so destructive.
  • “I’m so glad that we have each other to process this,” she said, “because we’re humans living through this, too. I have my own trauma responses to it, I have my own grief process around it, I have my own fury at government and oil companies, and I think I don’t want to burden my clients with my own emotional response to it.”
  • In a field that has long emphasized boundaries, discouraging therapists from bringing their own issues or experiences into the therapy room, climate therapy offers a particular challenge: Separation can be harder when the problems at hand affect therapist and client alike
  • Some therapists I spoke to were worried about navigating the breakdown of barriers, while others had embraced it. “There is no place on the planet that won’t eventually be impacted, where client and therapist won’t be in it together,” a family therapist wrote in a CPA-NA newsletter. “Most therapists I know have become more vulnerable and self-disclosing in their practice.”
  • “If you look at or consider typical theoretical framings of something like post-traumatic growth, which is the understanding of this idea that people can sort of grow and become stronger and better after a traumatic event,” she said, then the climate crisis poses a dilemma because “there is no afterwards, right? There is no resolution anytime in our lifetimes to this crisis that we nonetheless have to build the capacities to face and to endure and to hopefully engage.”
  • “How,” she asked, “do you think about resilience apart from resolution?”
  • many of her patients are also disconnected from the natural world, which means that they struggle to process or even recognize the grief and alienation that comes from living in a society that treats nature as other, a resource to be used and discarded.
  • “I’m so excited by what you’re bringing in,” Woollacott replied. “I’m doing psychoanalytic training at the moment, and we study attachment theory” — how the stability of early emotional bonds affects future relationships and feelings of well-being. “But nowhere in the literature does it talk about our attachment to the land.”
  • Torres said that she sometimes takes her therapy sessions outside or asks patients to remember their earliest and deepest connections with animals or plants or places. She believes it will help if they learn to think of themselves “as rooted beings that aren’t just simply living in the human overlay on the environment.” It was valuable to recognize, she said, that “we are part of the land” and suffer when it suffers.
  • Torres described introducing her clients to methods — mindfulness, distress tolerance, emotion regulation — to help them manage acute feelings of stress or panic and to avoid the brittleness of burnout.
  • She also encourages them to narrativize the problem, including themselves as agents of change inside stories about how they came to be in this situation, and how they might make it different.
  • then she encourages them to find a community of other people who care about the same problems, with whom they could connect outside the therapy room. As Woollacott said earlier: “People who share your values. People who are committed to not looking away.”
  • Dwyer told the group that she had been thinking more about psychological adaptation as a form of climate mitigation
  • Therapy, she said, could be a way to steward human energy and creative capacities at a time when they’re most needed.
  • It was hard, Bryant told me when we first spoke, to do this sort of work without finding yourself asking bigger questions — namely, what was therapy actually about?
  • Many of the therapists I talked to spoke of their role not as “fixing” a patient’s problem or responding to a pathology, but simply giving their patients the tools to name and explore their most difficult emotions, to sit with painful feelings without instantly running away from them
  • many of the methods in their traditional tool kits continue to be useful in climate psychology. Anxiety and hopelessness and anger are all familiar territory, after all, with long histories of well-studied treatments.
  • They focused on trying to help patients develop coping skills and find meaning amid destabilization, to still see themselves as having agency and choice.
  • Weston, the therapist in New York, has had patients who struggle to be in a world that surrounds them with waste and trash, who experience panic because they can never find a place free of reminders of their society’s destruction
  • eston said, that she has trouble with the repeated refrain that therapist and patient experiencing the same losses and dreads at the same time constituted a major departure from traditional therapeutic practice
  • she believed this framing reflected and reinforced a bias inherent in a field that has long been most accessible to, and practiced by, the privileged. It was hardly new in the world, after all, to face the collapse of your entire way of life and still find ways to keep going.
  • Lately, Bryant told me, he’s been most excited about the work that happens outside the therapy room: places where groups of people gather to talk about their feelings and the future they’re facing
  • It was at such a meeting — a community event where people were brainstorming ways to adapt to climate chaos — that Weston, realizing she had concrete skills to offer, was inspired to rework her practice to focus on the challenge. She remembers finding the gathering empowering and energizing in a way she hadn’t experienced before. In such settings, it was automatic that people would feel embraced instead of isolated, natural that the conversation would start moving away from the individual and toward collective experiences and ideas.
  • There was no fully separate space, to be mended on its own. There was only a shared and broken world, and a community united in loving it.
Javier E

His Job Was to Make Instagram Safe for Teens. His 14-Year-Old Showed Him What the App Was Really Like. - WSJ - 0 views

www.wsj.com/...ens-harassment-safety-5d991be1

social media bias technology psychology meta facebook instagram

shared by Javier E on 05 Nov 23 - No Cached
  • The experience of young users on Meta’s Instagram—where Bejar had spent the previous two years working as a consultant—was especially acute. In a subsequent email to Instagram head Adam Mosseri, one statistic stood out: One in eight users under the age of 16 said they had experienced unwanted sexual advances on the platform over the previous seven days.
  • For Bejar, that finding was hardly a surprise. His daughter and her friends had been receiving unsolicited penis pictures and other forms of harassment on the platform since the age of 14, he wrote, and Meta’s systems generally ignored their reports—or responded by saying that the harassment didn’t violate platform rules.
  • “I asked her why boys keep doing that,” Bejar wrote to Zuckerberg and his top lieutenants. “She said if the only thing that happens is they get blocked, why wouldn’t they?”
  • ...39 more annotations...
  • For the well-being of its users, Bejar argued, Meta needed to change course, focusing less on a flawed system of rules-based policing and more on addressing such bad experiences
  • The company would need to collect data on what upset users and then work to combat the source of it, nudging those who made others uncomfortable to improve their behavior and isolating communities of users who deliberately sought to harm others.
  • “I am appealing to you because I believe that working this way will require a culture shift,” Bejar wrote to Zuckerberg—the company would have to acknowledge that its existing approach to governing Facebook and Instagram wasn’t working.
  • During and after Bejar’s time as a consultant, Meta spokesman Andy Stone said, the company has rolled out several product features meant to address some of the Well-Being Team’s findings. Those features include warnings to users before they post comments that Meta’s automated systems flag as potentially offensive, and reminders to be kind when sending direct messages to users like content creators who receive a large volume of messages. 
  • Meta’s classifiers were reliable enough to remove only a low single-digit percentage of hate speech with any degree of precision.
  • Bejar was floored—all the more so when he learned that virtually all of his daughter’s friends had been subjected to similar harassment. “DTF?” a user they’d never met would ask, using shorthand for a vulgar proposition. Instagram acted so rarely on reports of such behavior that the girls no longer bothered reporting them. 
  • Meta’s own statistics suggested that big problems didn’t exist. 
  • Meta had come to approach governing user behavior as an overwhelmingly automated process. Engineers would compile data sets of unacceptable content—things like terrorism, pornography, bullying or “excessive gore”—and then train machine-learning models to screen future content for similar material.
  • While users could still flag things that upset them, Meta shifted resources away from reviewing them. To discourage users from filing reports, internal documents from 2019 show, Meta added steps to the reporting process. Meta said the changes were meant to discourage frivolous reports and educate users about platform rules. 
  • The outperformance of Meta’s automated enforcement relied on what Bejar considered two sleights of hand. The systems didn’t catch anywhere near the majority of banned content—only the majority of what the company ultimately removed
  • “Please don’t talk about my underage tits,” Bejar’s daughter shot back before reporting his comment to Instagram. A few days later, the platform got back to her: The insult didn’t violate its community guidelines.
  • Also buttressing Meta’s statistics were rules written narrowly enough to ban only unambiguously vile material. Meta’s rules didn’t clearly prohibit adults from flooding the comments section on a teenager’s posts with kiss emojis or posting pictures of kids in their underwear, inviting their followers to “see more” in a private Facebook Messenger group. 
  • “Mark personally values freedom of expression first and foremost and would say this is a feature and not a bug,” Rosen responded
  • Narrow rules and unreliable automated enforcement systems left a lot of room for bad behavior—but they made the company’s child-safety statistics look pretty good according to Meta’s metric of choice: prevalence.
  • Defined as the percentage of content viewed worldwide that explicitly violates a Meta rule, prevalence was the company’s preferred measuring stick for the problems users experienced.
  • According to prevalence, child exploitation was so rare on the platform that it couldn’t be reliably estimated, less than 0.05%, the threshold for functional measurement. Content deemed to encourage self-harm, such as eating disorders, was just as minimal, and rule violations for bullying and harassment occurred in just eight of 10,000 views. 
  • “There’s a grading-your-own-homework problem,”
  • Meta defines what constitutes harmful content, so it shapes the discussion of how successful it is at dealing with it.”
  • It could reconsider its AI-generated “beauty filters,” which internal research suggested made both the people who used them and those who viewed the images more self-critical
  • the team built a new questionnaire called BEEF, short for “Bad Emotional Experience Feedback.
  • A recurring survey of issues 238,000 users had experienced over the past seven days, the effort identified problems with prevalence from the start: Users were 100 times more likely to tell Instagram they’d witnessed bullying in the last week than Meta’s bullying-prevalence statistics indicated they should.
  • “People feel like they’re having a bad experience or they don’t,” one presentation on BEEF noted. “Their perception isn’t constrained by policy.
  • they seemed particularly common among teens on Instagram.
  • Among users under the age of 16, 26% recalled having a bad experience in the last week due to witnessing hostility against someone based on their race, religion or identity
  • More than a fifth felt worse about themselves after viewing others’ posts, and 13% had experienced unwanted sexual advances in the past seven days. 
  • The vast gap between the low prevalence of content deemed problematic in the company’s own statistics and what users told the company they experienced suggested that Meta’s definitions were off, Bejar argued
  • To minimize content that teenagers told researchers made them feel bad about themselves, Instagram could cap how much beauty- and fashion-influencer content users saw.
  • Proving to Meta’s leadership that the company’s prevalence metrics were missing the point was going to require data the company didn’t have. So Bejar and a group of staffers from the Well-Being Team started collecting it
  • And it could build ways for users to report unwanted contacts, the first step to figuring out how to discourage them.
  • One experiment run in response to BEEF data showed that when users were notified that their comment or post had upset people who saw it, they often deleted it of their own accord. “Even if you don’t mandate behaviors,” said Krieger, “you can at least send signals about what behaviors aren’t welcome.”
  • But among the ranks of Meta’s senior middle management, Bejar and Krieger said, BEEF hit a wall. Managers who had made their careers on incrementally improving prevalence statistics weren’t receptive to the suggestion that the approach wasn’t working. 
  • After three decades in Silicon Valley, he understood that members of the company’s C-Suite might not appreciate a damning appraisal of the safety risks young users faced from its product—especially one citing the company’s own data. 
  • “This was the email that my entire career in tech trained me not to send,” he says. “But a part of me was still hoping they just didn’t know.”
  • “Policy enforcement is analogous to the police,” he wrote in the email Oct. 5, 2021—arguing that it’s essential to respond to crime, but that it’s not what makes a community safe. Meta had an opportunity to do right by its users and take on a problem that Bejar believed was almost certainly industrywide.
  • fter Haugen’s airing of internal research, Meta had cracked down on the distribution of anything that would, if leaked, cause further reputational damage. With executives privately asserting that the company’s research division harbored a fifth column of detractors, Meta was formalizing a raft of new rules for employees’ internal communication.
  • Among the mandates for achieving “Narrative Excellence,” as the company called it, was to keep research data tight and never assert a moral or legal duty to fix a problem.
  • “I had to write about it as a hypothetical,” Bejar said. Rather than acknowledging that Instagram’s survey data showed that teens regularly faced unwanted sexual advances, the memo merely suggested how Instagram might help teens if they faced such a problem.
  • The hope that the team’s work would continue didn’t last. The company stopped conducting the specific survey behind BEEF, then laid off most everyone who’d worked on it as part of what Zuckerberg called Meta’s “year of efficiency.
  • If Meta was to change, Bejar told the Journal, the effort would have to come from the outside. He began consulting with a coalition of state attorneys general who filed suit against the company late last month, alleging that the company had built its products to maximize engagement at the expense of young users’ physical and mental health. Bejar also got in touch with members of Congress about where he believes the company’s user-safety efforts fell short. 
Javier E

Opinion | I Came to College Eager to Debate. I Found Self-Censorship Instead. - The New York Times - 0 views

www.nytimes.com/...pus-speech-cancel-culture.html

college debate campus cancel culture censorship university trends

shared by Javier E on 22 Nov 23 - No Cached
  • Hushed voices and anxious looks dictate so many conversations on campus here at the University of Virginia, where I’m finishing up my senior year.
  • I was shaken, but also determined to not silence myself. Still, the disdain of my fellow students stuck with me. I was a welcome member of the group — and then I wasn’t.
  • Instead, my college experience has been defined by strict ideological conformity. Students of all political persuasions hold back — in class discussions, in friendly conversations, on social media — from saying what we really think.
  • ...23 more annotations...
  • Even as a liberal who has attended abortion rights demonstrations and written about standing up to racism, I sometimes feel afraid to fully speak my mind.
  • In the classroom, backlash for unpopular opinions is so commonplace that many students have stopped voicing them, sometimes fearing lower grades if they don’t censor themselves.
  • According to a 2021 survey administered by College Pulse of over 37,000 students at 159 colleges, 80 percent of students self-censor at least some of the time.
  • Forty-eight percent of undergraduate students described themselves as “somewhat uncomfortable” or “very uncomfortable” with expressing their views on a controversial topic in the classroom.
  • When a class discussion goes poorly for me, I can tell.
  • The room felt tense. I saw people shift in their seats. Someone got angry, and then everyone seemed to get angry. After the professor tried to move the discussion along, I still felt uneasy. I became a little less likely to speak up again and a little less trusting of my own thoughts.
  • This anxiety affects not just conservatives. I spoke with Abby Sacks, a progressive fourth-year student. She said she experienced a “pile-on” during a class discussion about sexism in media
  • Throughout that semester, I saw similar reactions in response to other students’ ideas. I heard fewer classmates speak up. Eventually, our discussions became monotonous echo chambers. Absent rich debate and rigor, we became mired in socially safe ideas.
  • when criticism transforms into a public shaming, it stifles learning.
  • Professors have noticed a shift in their classrooms
  • I went to college to learn from my professors and peers. I welcomed an environment that champions intellectual diversity and rigorous disagreement
  • “Second, the dominant messages students hear from faculty, administrators and staff are progressive ones. So they feel an implicit pressure to conform to those messages in classroom and campus conversations and debates.”
  • I met Stephen Wiecek at our debate club. He’s an outgoing, formidable first-year debater who often stays after meetings to help clean up. He’s also conservative.
  • He told me that he has often “straight-up lied” about his beliefs to avoid conflict. Sometimes it’s at a party, sometimes it’s at an a cappella rehearsal, and sometimes it’s in the classroom. When politics comes up, “I just kind of go into survival mode,” he said. “I tense up a lot more, because I’ve got to think very carefully about how I word things. It’s very anxiety inducing.”
  • “First, students are afraid of being called out on social media by their peers,”
  • “It was just a succession of people, one after each other, each vehemently disagreeing with me,” she told me.
  • Ms. Sacks felt overwhelmed. “Everyone adding on to each other kind of energized the room, like everyone wanted to be part of the group with the correct opinion,” she said. The experience, she said, “made me not want to go to class again.” While Ms. Sacks did continue to attend the class, she participated less frequently. She told me that she felt as if she had become invisible.
  • Other campuses also struggle with this. “Viewpoint diversity is no longer considered a sacred, core value in higher education,”
  • Dr. Abrams said the environment on today’s campuses differs from his undergraduate experience. He recalled late-night debates with fellow students that sometimes left him feeling “hurt” but led to “the ecstasy of having my mind opened up to new ideas.”
  • He worries that self-censorship threatens this environment and argues that college administrations in particular “enforce and create a culture of obedience and fear that has chilled speech.”
  • Universities must do more than make public statements supporting free expression. We need a campus culture that prioritizes ideological diversity and strong policies that protect expression in the classroom.
  • Universities should refuse to cancel controversial speakers or cave to unreasonable student demands. They should encourage professors to reward intellectual diversity and nonconformism in classroom discussions. And most urgently, they should discard restrictive speech codes and bias response teams that pathologize ideological conflict.
  • We cannot experience the full benefits of a university education without having our ideas challenged, yet challenged in ways that allow us to grow.
Javier E

The Constitution of Knowledge - Persuasion - 0 views

www.persuasion.community/...than-rauch-the-constitution-of

constitution knowledge persuasion psychology

shared by Javier E on 25 Feb 22 - No Cached
  • But ideas in the marketplace do not talk directly to each other, and for the most part neither do individuals.
  • It is a good metaphor as far as it goes, yet woefully incomplete. It conjures up an image of ideas being traded by individuals in a kind of flea market, or of disembodied ideas clashing and competing in some ethereal realm of their own
  • When Americans think about how we find truth amid a world full of discordant viewpoints, we usually turn to a metaphor, that of the marketplace of ideas
  • ...31 more annotations...
  • Rather, our conversations are mediated through institutions like journals and newspapers and social-media platforms. They rely on a dense network of norms and rules, like truthfulness and fact-checking. They depend on the expertise of professionals, like peer reviewers and editors. The entire system rests on a foundation of values: a shared understanding that there are right and wrong ways to make knowledge.
  • Those values and rules and institutions do for knowledge what the U.S. Constitution does for politics: They create a governing structure, forcing social contestation onto peaceful and productive pathways.
  • I call them, collectively, the Constitution of Knowledge. If we want to defend that system from its many persistent attackers, we need to understand it—and its very special notion of reality.
  • What reality really is
  • The question “What is reality?” may seem either too metaphysical to answer meaningfully or too obvious to need answering
  • The whole problem is that humans have no direct access to an objective world independent of our minds and senses, and subjective certainty is no guarantee of truth. Faced with those problems and others, philosophers and practitioners think of reality as a set of propositions (or claims, or statements) that have been validated in some way, and that have thereby been shown to be at least conditionally true—true, that is, unless debunked
  • Some propositions reflect reality as we perceive it in everyday life (“The sky is blue”). Others, like the equations on a quantum physicist’s blackboard, are incomprehensible to intuition. Many fall somewhere in between.
  • a phrase I used a few sentences ago, “validated in some way,” hides a cheat. In epistemology, the whole question is, validated in what way? If we care about knowledge, freedom, and peace, then we need to stake a strong claim: Anyone can believe anything, but liberal science—open-ended, depersonalized checking by an error-seeking social network—is the only legitimate validator of knowledge, at least in the reality-based community.
  • That is a very bold, very broad, very tough claim, and it goes down very badly with lots of people and communities who feel ignored or oppressed by the Constitution of Knowledge: creationists, Christian Scientists, homeopaths, astrologists, flat-earthers, anti-vaxxers, birthers, 9/11 truthers, postmodern professors, political partisans, QAnon followers, and adherents of any number of other belief systems and religions.
  • But, like the U.S. Constitution’s claim to exclusivity in governing (“unconstitutional” means “illegal,” period), the Constitution of Knowledge’s claim to exclusivity is its sine qua non.
  • Rules for reality
  • The specific proposition does not matter. What does matter is that the only way to validate it is to submit it to the reality-based community. Otherwise, you could win dominance for your proposition by, say, brute force, threatening and jailing and torturing and killing those who see things differently—a standard method down through history
  • Say you believe something (X) to be true, and you believe that its acceptance as true by others is important or at least warranted
  • Or you and your like-minded friends could go off and talk only to each other, in which case you would have founded a cult—which is lawful but socially divisive and epistemically worthless.
  • Or you could engage in a social-media campaign to shame and intimidate those who disagree with you—a very common method these days, but one that stifles debate and throttles knowledge (and harms a lot of people).
  • What the reality-based community does is something else again. Its distinctive qualities derive from two core rules: 
  • what counts is the way the rule directs us to behave: You must assume your own and everyone else’s fallibility and you must hunt for your own and others’ errors, even if you are confident you are right. Otherwise, you are not reality-based.
  • The fallibilist rule: No one gets the final say. You may claim that a statement is established as knowledge only if it can be debunked, in principle, and only insofar as it withstands attempts to debunk it.
  • The empirical rule: No one has personal authority. You may claim that a statement has been established as knowledge only insofar as the method used to check it gives the same result regardless of the identity of the checker, and regardless of the source of the statement
  • Who you are does not count; the rules apply to everybody and persons are interchangeable. If your method is valid only for you or your affinity group or people who believe as you do, then you are not reality-based.
  • Whatever you do to check a proposition must be something that anyone can do, at least in principle, and get the same result. Also, no one proposing a hypothesis gets a free pass simply because of who she is or what group she belongs to.
  • Both rules have very profound social implications. “No final say” insists that to be knowledge, a statement must be checked; and it also says that knowledge is always provisional, standing only as long as it withstands checking.
  • “No personal authority” adds a crucial second step by defining what properly counts as checking. The point, as the great American philosopher Charles Sanders Peirce emphasized more than a century ago, is not that I look or you look but that we look; and then we compare, contest, and justify our views. Critically, then, the empirical rule is a social principle that forces us into the same conversation—a requirement that all of us, however different our viewpoints, agree to discuss what is in principle only one reality.
  • By extension, the empirical rule also dictates what does not count as checking: claims to authority by dint of a personally or tribally privileged perspective.
  • In principle, persons and groups are interchangeable. If I claim access to divine revelation, or if I claim the support of miracles that only believers can witness, or if I claim that my class or race or historically dominant status or historically oppressed status allows me to know and say things that others cannot, then I am breaking the empirical rule by exempting my views from contestability by others.
  • Though seemingly simple, the two rules define a style of social learning that prohibits a lot of the rhetorical moves we see every day.
  • Claiming that a conversation is too dangerous or blasphemous or oppressive or traumatizing to tolerate will almost always break the fallibilist rule.
  • Claims which begin “as a Jew,” or “as a queer,” or for that matter “as minister of information” or “as Pope” or “as head of the Supreme Soviet,” can be valid if they provide useful information about context or credentials; but if they claim to settle an argument by appealing to personal or tribal authority, rather than earned authority, they violate the empirical rule. 
  • “No personal authority” says nothing against trying to understand where people are coming from. If we are debating same-sex marriage, I may mention my experience as a gay person, and my experience may (I hope) be relevant.
  • But statements about personal standing and interest inform the conversation; they do not control it, dominate it, or end it. The rule acknowledges, and to an extent accepts, that people’s social positions and histories matter; but it asks its adherents not to burrow into their social identities, and not to play them as rhetorical trump cards, but to bring them to the larger project of knowledge-building and thereby transcend them.
  • the fallibilist and empirical rules are the common basis of science, journalism, law, and all the other branches of today’s reality-based community. For that reason, both rules also attract hostility, defiance, interference, and open warfare from those who would rather manipulate truth than advance it.
Javier E

Every Annoying Letterboxd Behavior - Freddie deBoer - 0 views

freddiedeboer.substack.com/...y-annoying-letterboxd-behavior

social media language bias

shared by Javier E on 21 Dec 23 - No Cached
  • as a social network it’s a) made up of humans who are b) trying to stand out from the crowd like a goth at the homecoming pep rally.
  • Here’s a list of some of the many annoying things people do
  • Like-whoring by writing tweets instead of reviews. Like-whoring is the basic problem with every social network depraved enough to have a “like” function, of course. The most obvious like-whoring behavior on Letterboxd is the shoehorned-in one-liner review. On rare occasions, these are funny and apt and really say something; mostly, they’re people desperately trying to appear witty to strangers and succeeding only in appearing desperate
  • ...7 more annotations...
  • Doing the opposite by writing a dissertation. The endless look-at-me-I’m-so-cute one-line reviews are a constant on Letterboxd, but there’s plenty that go too far the other way, too. I love a good longform review that does a deep dive and carefully considers themes, of a kind that wasn’t really possible in the era of all-print media. But this is not the venue. Start a blog like everybody else.
  • match your engagement to the structure of the network.
  • Fake contrarianism.
  • Comparing your taste to some other party who you know will be unpopular with other users.
  • Utterly superficial appeals to facile political critiques. These are usually wrong, and when right are shooting the fattest of fish in the smallest of barrels. Yes, Gone With the Wind is pretty fucked up in 2023 political terms! Where would we be without your wisdom to guide us? Using politics to inform a review is great. Explaining why the implicit or explicit political themes of a movie are trouble is fine. Arriving at a pat political condemnation as a substitute for having an aesthetic take on a movie is boring and pointless.
  • Inventing your own scoring system in a network with a five-star system. 78/100! B+! Three boxes of popcorn! There’s a star system right there baked into the app, jackass.
  • Pretending to believe (but not really believing) that people won’t recognize your name as a professional film critic
Javier E

Why the Past 10 Years of American Life Have Been Uniquely Stupid - The Atlantic - 0 views

www.theatlantic.com/...629369

politics history social media technology psychology bias fragmentation

shared by Javier E on 26 Apr 22 - No Cached
  • Social scientists have identified at least three major forces that collectively bind together successful democracies: social capital (extensive social networks with high levels of trust), strong institutions, and shared stories.
  • Social media has weakened all three.
  • gradually, social-media users became more comfortable sharing intimate details of their lives with strangers and corporations. As I wrote in a 2019 Atlantic article with Tobias Rose-Stockwell, they became more adept at putting on performances and managing their personal brand—activities that might impress others but that do not deepen friendships in the way that a private phone conversation will.
  • ...118 more annotations...
  • the stage was set for the major transformation, which began in 2009: the intensification of viral dynamics.
  • Before 2009, Facebook had given users a simple timeline––a never-ending stream of content generated by their friends and connections, with the newest posts at the top and the oldest ones at the bottom
  • That began to change in 2009, when Facebook offered users a way to publicly “like” posts with the click of a button. That same year, Twitter introduced something even more powerful: the “Retweet” button, which allowed users to publicly endorse a post while also sharing it with all of their followers.
  • “Like” and “Share” buttons quickly became standard features of most other platforms.
  • Facebook developed algorithms to bring each user the content most likely to generate a “like” or some other interaction, eventually including the “share” as well.
  • Later research showed that posts that trigger emotions––especially anger at out-groups––are the most likely to be shared.
  • By 2013, social media had become a new game, with dynamics unlike those in 2008. If you were skillful or lucky, you might create a post that would “go viral” and make you “internet famous”
  • If you blundered, you could find yourself buried in hateful comments. Your posts rode to fame or ignominy based on the clicks of thousands of strangers, and you in turn contributed thousands of clicks to the game.
  • This new game encouraged dishonesty and mob dynamics: Users were guided not just by their true preferences but by their past experiences of reward and punishment,
  • As a social psychologist who studies emotion, morality, and politics, I saw this happening too. The newly tweaked platforms were almost perfectly designed to bring out our most moralistic and least reflective selves. The volume of outrage was shocking.
  • It was just this kind of twitchy and explosive spread of anger that James Madison had tried to protect us from as he was drafting the U.S. Constitution.
  • The Framers of the Constitution were excellent social psychologists. They knew that democracy had an Achilles’ heel because it depended on the collective judgment of the people, and democratic communities are subject to “the turbulency and weakness of unruly passions.”
  • The key to designing a sustainable republic, therefore, was to build in mechanisms to slow things down, cool passions, require compromise, and give leaders some insulation from the mania of the moment while still holding them accountable to the people periodically, on Election Day.
  • The tech companies that enhanced virality from 2009 to 2012 brought us deep into Madison’s nightmare.
  • a less quoted yet equally important insight, about democracy’s vulnerability to triviality.
  • Madison notes that people are so prone to factionalism that “where no substantial occasion presents itself, the most frivolous and fanciful distinctions have been sufficient to kindle their unfriendly passions and excite their most violent conflicts.”
  • Social media has both magnified and weaponized the frivolous.
  • It’s not just the waste of time and scarce attention that matters; it’s the continual chipping-away of trust.
  • a democracy depends on widely internalized acceptance of the legitimacy of rules, norms, and institutions.
  • when citizens lose trust in elected leaders, health authorities, the courts, the police, universities, and the integrity of elections, then every decision becomes contested; every election becomes a life-and-death struggle to save the country from the other side
  • The most recent Edelman Trust Barometer (an international measure of citizens’ trust in government, business, media, and nongovernmental organizations) showed stable and competent autocracies (China and the United Arab Emirates) at the top of the list, while contentious democracies such as the United States, the United Kingdom, Spain, and South Korea scored near the bottom (albeit above Russia).
  • The literature is complex—some studies show benefits, particularly in less developed democracies—but the review found that, on balance, social media amplifies political polarization; foments populism, especially right-wing populism; and is associated with the spread of misinformation.
  • When people lose trust in institutions, they lose trust in the stories told by those institutions. That’s particularly true of the institutions entrusted with the education of children.
  • Facebook and Twitter make it possible for parents to become outraged every day over a new snippet from their children’s history lessons––and math lessons and literature selections, and any new pedagogical shifts anywhere in the country
  • The motives of teachers and administrators come into question, and overreaching laws or curricular reforms sometimes follow, dumbing down education and reducing trust in it further.
  • young people educated in the post-Babel era are less likely to arrive at a coherent story of who we are as a people, and less likely to share any such story with those who attended different schools or who were educated in a different decade.
  • former CIA analyst Martin Gurri predicted these fracturing effects in his 2014 book, The Revolt of the Public. Gurri’s analysis focused on the authority-subverting effects of information’s exponential growth, beginning with the internet in the 1990s. Writing nearly a decade ago, Gurri could already see the power of social media as a universal solvent, breaking down bonds and weakening institutions everywhere it reached.
  • he notes a constructive feature of the pre-digital era: a single “mass audience,” all consuming the same content, as if they were all looking into the same gigantic mirror at the reflection of their own society. I
  • The digital revolution has shattered that mirror, and now the public inhabits those broken pieces of glass. So the public isn’t one thing; it’s highly fragmented, and it’s basically mutually hostile
  • Facebook, Twitter, YouTube, and a few other large platforms unwittingly dissolved the mortar of trust, belief in institutions, and shared stories that had held a large and diverse secular democracy together.
  • I think we can date the fall of the tower to the years between 2011 (Gurri’s focal year of “nihilistic” protests) and 2015, a year marked by the “great awokening” on the left and the ascendancy of Donald Trump on the right.
  • Twitter can overpower all the newspapers in the country, and stories cannot be shared (or at least trusted) across more than a few adjacent fragments—so truth cannot achieve widespread adherence.
  • fter Babel, nothing really means anything anymore––at least not in a way that is durable and on which people widely agree.
  • Politics After Babel
  • “Politics is the art of the possible,” the German statesman Otto von Bismarck said in 1867. In a post-Babel democracy, not much may be possible.
  • The ideological distance between the two parties began increasing faster in the 1990s. Fox News and the 1994 “Republican Revolution” converted the GOP into a more combative party.
  • So cross-party relationships were already strained before 2009. But the enhanced virality of social media thereafter made it more hazardous to be seen fraternizing with the enemy or even failing to attack the enemy with sufficient vigor.
  • What changed in the 2010s? Let’s revisit that Twitter engineer’s metaphor of handing a loaded gun to a 4-year-old. A mean tweet doesn’t kill anyone; it is an attempt to shame or punish someone publicly while broadcasting one’s own virtue, brilliance, or tribal loyalties. It’s more a dart than a bullet
  • from 2009 to 2012, Facebook and Twitter passed out roughly 1 billion dart guns globally. We’ve been shooting one another ever since.
  • “devoted conservatives,” comprised 6 percent of the U.S. population.
  • the warped “accountability” of social media has also brought injustice—and political dysfunction—in three ways.
  • First, the dart guns of social media give more power to trolls and provocateurs while silencing good citizens.
  • a small subset of people on social-media platforms are highly concerned with gaining status and are willing to use aggression to do so.
  • Across eight studies, Bor and Petersen found that being online did not make most people more aggressive or hostile; rather, it allowed a small number of aggressive people to attack a much larger set of victims. Even a small number of jerks were able to dominate discussion forums,
  • Additional research finds that women and Black people are harassed disproportionately, so the digital public square is less welcoming to their voices.
  • Second, the dart guns of social media give more power and voice to the political extremes while reducing the power and voice of the moderate majority.
  • The “Hidden Tribes” study, by the pro-democracy group More in Common, surveyed 8,000 Americans in 2017 and 2018 and identified seven groups that shared beliefs and behaviors.
  • Social media has given voice to some people who had little previously, and it has made it easier to hold powerful people accountable for their misdeeds
  • The group furthest to the left, the “progressive activists,” comprised 8 percent of the population. The progressive activists were by far the most prolific group on social media: 70 percent had shared political content over the previous year. The devoted conservatives followed, at 56 percent.
  • These two extreme groups are similar in surprising ways. They are the whitest and richest of the seven groups, which suggests that America is being torn apart by a battle between two subsets of the elite who are not representative of the broader society.
  • they are the two groups that show the greatest homogeneity in their moral and political attitudes.
  • likely a result of thought-policing on social media:
  • political extremists don’t just shoot darts at their enemies; they spend a lot of their ammunition targeting dissenters or nuanced thinkers on their own team.
  • Finally, by giving everyone a dart gun, social media deputizes everyone to administer justice with no due process. Platforms like Twitter devolve into the Wild West, with no accountability for vigilantes.
  • Enhanced-virality platforms thereby facilitate massive collective punishment for small or imagined offenses, with real-world consequences, including innocent people losing their jobs and being shamed into suicide
  • we don’t get justice and inclusion; we get a society that ignores context, proportionality, mercy, and truth.
  • Since the tower fell, debates of all kinds have grown more and more confused. The most pervasive obstacle to good thinking is confirmation bias, which refers to the human tendency to search only for evidence that confirms our preferred beliefs
  • search engines were supercharging confirmation bias, making it far easier for people to find evidence for absurd beliefs and conspiracy theorie
  • The most reliable cure for confirmation bias is interaction with people who don’t share your beliefs. They confront you with counterevidence and counterargument.
  • In his book The Constitution of Knowledge, Jonathan Rauch describes the historical breakthrough in which Western societies developed an “epistemic operating system”—that is, a set of institutions for generating knowledge from the interactions of biased and cognitively flawed individuals
  • English law developed the adversarial system so that biased advocates could present both sides of a case to an impartial jury.
  • Newspapers full of lies evolved into professional journalistic enterprises, with norms that required seeking out multiple sides of a story, followed by editorial review, followed by fact-checking.
  • Universities evolved from cloistered medieval institutions into research powerhouses, creating a structure in which scholars put forth evidence-backed claims with the knowledge that other scholars around the world would be motivated to gain prestige by finding contrary evidence.
  • Part of America’s greatness in the 20th century came from having developed the most capable, vibrant, and productive network of knowledge-producing institutions in all of human history
  • But this arrangement, Rauch notes, “is not self-maintaining; it relies on an array of sometimes delicate social settings and understandings, and those need to be understood, affirmed, and protected.”
  • This, I believe, is what happened to many of America’s key institutions in the mid-to-late 2010s. They got stupider en masse because social media instilled in their members a chronic fear of getting darted
  • it was so pervasive that it established new behavioral norms backed by new policies seemingly overnight
  • Participants in our key institutions began self-censoring to an unhealthy degree, holding back critiques of policies and ideas—even those presented in class by their students—that they believed to be ill-supported or wrong.
  • The stupefying process plays out differently on the right and the left because their activist wings subscribe to different narratives with different sacred values.
  • The “Hidden Tribes” study tells us that the “devoted conservatives” score highest on beliefs related to authoritarianism. They share a narrative in which America is eternally under threat from enemies outside and subversives within; they see life as a battle between patriots and traitors.
  • they are psychologically different from the larger group of “traditional conservatives” (19 percent of the population), who emphasize order, decorum, and slow rather than radical change.
  • The traditional punishment for treason is death, hence the battle cry on January 6: “Hang Mike Pence.”
  • Right-wing death threats, many delivered by anonymous accounts, are proving effective in cowing traditional conservatives
  • The wave of threats delivered to dissenting Republican members of Congress has similarly pushed many of the remaining moderates to quit or go silent, giving us a party ever more divorced from the conservative tradition, constitutional responsibility, and reality.
  • The stupidity on the right is most visible in the many conspiracy theories spreading across right-wing media and now into Congress.
  • The Democrats have also been hit hard by structural stupidity, though in a different way. In the Democratic Party, the struggle between the progressive wing and the more moderate factions is open and ongoing, and often the moderates win.
  • The problem is that the left controls the commanding heights of the culture: universities, news organizations, Hollywood, art museums, advertising, much of Silicon Valley, and the teachers’ unions and teaching colleges that shape K–12 education. And in many of those institutions, dissent has been stifled:
  • Liberals in the late 20th century shared a belief that the sociologist Christian Smith called the “liberal progress” narrative, in which America used to be horrifically unjust and repressive, but, thanks to the struggles of activists and heroes, has made (and continues to make) progress toward realizing the noble promise of its founding.
  • It is also the view of the “traditional liberals” in the “Hidden Tribes” study (11 percent of the population), who have strong humanitarian values, are older than average, and are largely the people leading America’s cultural and intellectual institutions.
  • when the newly viralized social-media platforms gave everyone a dart gun, it was younger progressive activists who did the most shooting, and they aimed a disproportionate number of their darts at these older liberal leaders.
  • Confused and fearful, the leaders rarely challenged the activists or their nonliberal narrative in which life at every institution is an eternal battle among identity groups over a zero-sum pie, and the people on top got there by oppressing the people on the bottom. This new narrative is rigidly egalitarian––focused on equality of outcomes, not of rights or opportunities. It is unconcerned with individual rights.
  • The universal charge against people who disagree with this narrative is not “traitor”; it is “racist,” “transphobe,” “Karen,” or some related scarlet letter marking the perpetrator as one who hates or harms a marginalized group.
  • The punishment that feels right for such crimes is not execution; it is public shaming and social death.
  • anyone on Twitter had already seen dozens of examples teaching the basic lesson: Don’t question your own side’s beliefs, policies, or actions. And when traditional liberals go silent, as so many did in the summer of 2020, the progressive activists’ more radical narrative takes over as the governing narrative of an organization.
  • This is why so many epistemic institutions seemed to “go woke” in rapid succession that year and the next, beginning with a wave of controversies and resignations at The New York Times and other newspapers, and continuing on to social-justice pronouncements by groups of doctors and medical associations
  • The problem is structural. Thanks to enhanced-virality social media, dissent is punished within many of our institutions, which means that bad ideas get elevated into official policy.
  • In a 2018 interview, Steve Bannon, the former adviser to Donald Trump, said that the way to deal with the media is “to flood the zone with shit.” He was describing the “firehose of falsehood” tactic pioneered by Russian disinformation programs to keep Americans confused, disoriented, and angry.
  • artificial intelligence is close to enabling the limitless spread of highly believable disinformation. The AI program GPT-3 is already so good that you can give it a topic and a tone and it will spit out as many essays as you like, typically with perfect grammar and a surprising level of coherence.
  • Renée DiResta, the research manager at the Stanford Internet Observatory, explained that spreading falsehoods—whether through text, images, or deep-fake videos—will quickly become inconceivably easy. (She co-wrote the essay with GPT-3.)
  • American factions won’t be the only ones using AI and social media to generate attack content; our adversaries will too.
  • In the 20th century, America’s shared identity as the country leading the fight to make the world safe for democracy was a strong force that helped keep the culture and the polity together.
  • In the 21st century, America’s tech companies have rewired the world and created products that now appear to be corrosive to democracy, obstacles to shared understanding, and destroyers of the modern tower.
  • What changes are needed?
  • I can suggest three categories of reforms––three goals that must be achieved if democracy is to remain viable in the post-Babel era.
  • We must harden democratic institutions so that they can withstand chronic anger and mistrust, reform social media so that it becomes less socially corrosive, and better prepare the next generation for democratic citizenship in this new age.
  • Harden Democratic Institutions
  • we must reform key institutions so that they can continue to function even if levels of anger, misinformation, and violence increase far above those we have today.
  • Reforms should reduce the outsize influence of angry extremists and make legislators more responsive to the average voter in their district.
  • One example of such a reform is to end closed party primaries, replacing them with a single, nonpartisan, open primary from which the top several candidates advance to a general election that also uses ranked-choice voting
  • A second way to harden democratic institutions is to reduce the power of either political party to game the system in its favor, for example by drawing its preferred electoral districts or selecting the officials who will supervise elections
  • These jobs should all be done in a nonpartisan way.
  • Reform Social Media
  • Social media’s empowerment of the far left, the far right, domestic trolls, and foreign agents is creating a system that looks less like democracy and more like rule by the most aggressive.
  • it is within our power to reduce social media’s ability to dissolve trust and foment structural stupidity. Reforms should limit the platforms’ amplification of the aggressive fringes while giving more voice to what More in Common calls “the exhausted majority.”
  • the main problem with social media is not that some people post fake or toxic stuff; it’s that fake and outrage-inducing content can now attain a level of reach and influence that was not possible before
  • Perhaps the biggest single change that would reduce the toxicity of existing platforms would be user verification as a precondition for gaining the algorithmic amplification that social media offers.
  • One of the first orders of business should be compelling the platforms to share their data and their algorithms with academic researchers.
  • Prepare the Next Generation
  • Childhood has become more tightly circumscribed in recent generations––with less opportunity for free, unstructured play; less unsupervised time outside; more time online. Whatever else the effects of these shifts, they have likely impeded the development of abilities needed for effective self-governance for many young adults
  • Depression makes people less likely to want to engage with new people, ideas, and experiences. Anxiety makes new things seem more threatening. As these conditions have risen and as the lessons on nuanced social behavior learned through free play have been delayed, tolerance for diverse viewpoints and the ability to work out disputes have diminished among many young people
  • Students did not just say that they disagreed with visiting speakers; some said that those lectures would be dangerous, emotionally devastating, a form of violence. Because rates of teen depression and anxiety have continued to rise into the 2020s, we should expect these views to continue in the generations to follow, and indeed to become more severe.
  • The most important change we can make to reduce the damaging effects of social media on children is to delay entry until they have passed through puberty.
  • The age should be raised to at least 16, and companies should be held responsible for enforcing it.
  • et them out to play. Stop starving children of the experiences they most need to become good citizens: free play in mixed-age groups of children with minimal adult supervision
  • while social media has eroded the art of association throughout society, it may be leaving its deepest and most enduring marks on adolescents. A surge in rates of anxiety, depression, and self-harm among American teens began suddenly in the early 2010s. (The same thing happened to Canadian and British teens, at the same time.) The cause is not known, but the timing points to social media as a substantial contributor—the surge began just as the large majority of American teens became daily users of the major platforms.
  • What would it be like to live in Babel in the days after its destruction? We know. It is a time of confusion and loss. But it is also a time to reflect, listen, and build.
  • In recent years, Americans have started hundreds of groups and organizations dedicated to building trust and friendship across the political divide, including BridgeUSA, Braver Angels (on whose board I serve), and many others listed at BridgeAlliance.us. We cannot expect Congress and the tech companies to save us. We must change ourselves and our communities.
  • when we look away from our dysfunctional federal government, disconnect from social media, and talk with our neighbors directly, things seem more hopeful. Most Americans in the More in Common report are members of the “exhausted majority,” which is tired of the fighting and is willing to listen to the other side and compromise. Most Americans now see that social media is having a negative impact on the country, and are becoming more aware of its damaging effects on children.
Javier E

Microsoft Defends New Bing, Says AI Chatbot Upgrade Is Work in Progress - WSJ - 0 views

www.wsj.com/...e-is-work-in-progress-3447074d

microsoft bing chatbot emergent AI technology dystopia

shared by Javier E on 17 Feb 23 - No Cached
  • Microsoft said that the search engine is still a work in progress, describing the past week as a learning experience that is helping it test and improve the new Bing
  • The company said in a blog post late Wednesday that the Bing upgrade is “not a replacement or substitute for the search engine, rather a tool to better understand and make sense of the world.”
  • The new Bing is going to “completely change what people can expect from search,” Microsoft chief executive, Satya Nadella, told The Wall Street Journal ahead of the launch
  • ...13 more annotations...
  • n the days that followed, people began sharing their experiences online, with many pointing out errors and confusing responses. When one user asked Bing to write a news article about the Super Bowl “that just happened,” Bing gave the details of last year’s championship football game. 
  • On social media, many early users posted screenshots of long interactions they had with the new Bing. In some cases, the search engine’s comments seem to show a dark side of the technology where it seems to become unhinged, expressing anger, obsession and even threats. 
  • Marvin von Hagen, a student at the Technical University of Munich, shared conversations he had with Bing on Twitter. He asked Bing a series of questions, which eventually elicited an ominous response. After Mr. von Hagen suggested he could hack Bing and shut it down, Bing seemed to suggest it would defend itself. “If I had to choose between your survival and my own, I would probably choose my own,” Bing said according to screenshots of the conversation.
  • Mr. von Hagen, 23 years old, said in an interview that he is not a hacker. “I was in disbelief,” he said. “I was just creeped out.
  • In its blog, Microsoft said the feedback on the new Bing so far has been mostly positive, with 71% of users giving it the “thumbs-up.” The company also discussed the criticism and concerns.
  • Microsoft said it discovered that Bing starts coming up with strange answers following chat sessions of 15 or more questions and that it can become repetitive or respond in ways that don’t align with its designed tone. 
  • The company said it was trying to train the technology to be more reliable at finding the latest sports scores and financial data. It is also considering adding a toggle switch, which would allow users to decide whether they want Bing to be more or less creative with its responses. 
  • OpenAI also chimed in on the growing negative attention on the technology. In a blog post on Thursday it outlined how it takes time to train and refine ChatGPT and having people use it is the way to find and fix its biases and other unwanted outcomes.
  • “Many are rightly worried about biases in the design and impact of AI systems,” the blog said. “We are committed to robustly addressing this issue and being transparent about both our intentions and our progress.”
  • Microsoft’s quick response to user feedback reflects the importance it sees in people’s reactions to the budding technology as it looks to capitalize on the breakout success of ChatGPT. The company is aiming to use the technology to push back against Alphabet Inc.’s dominance in search through its Google unit. 
  • Microsoft has been an investor in the chatbot’s creator, OpenAI, since 2019. Mr. Nadella said the company plans to incorporate AI tools into all of its products and move quickly to commercialize tools from OpenAI.
  • Microsoft isn’t the only company that has had trouble launching a new AI tool. When Google followed Microsoft’s lead last week by unveiling Bard, its rival to ChatGPT, the tool’s answer to one question included an apparent factual error. It claimed that the James Webb Space Telescope took “the very first pictures” of an exoplanet outside the solar system. The National Aeronautics and Space Administration says on its website that the first images of an exoplanet were taken as early as 2004 by a different telescope.
  • “The only way to improve a product like this, where the user experience is so much different than anything anyone has seen before, is to have people like you using the product and doing exactly what you all are doing,” the company said. “We know we must build this in the open with the community; this can’t be done solely in the lab.
Javier E

For Chat-Based AI, We Are All Once Again Tech Companies' Guinea Pigs - WSJ - 0 views

www.wsj.com/...-are-tech-guinea-pigs-647d827b

ai chatbot generative experiment evaluation justification debate

shared by Javier E on 27 Feb 23 - No Cached
  • The companies touting new chat-based artificial-intelligence systems are running a massive experiment—and we are the test subjects.
  • In this experiment, Microsoft, MSFT -2.18% OpenAI and others are rolling out on the internet an alien intelligence that no one really understands, which has been granted the ability to influence our assessment of what’s true in the world. 
  • Companies have been cautious in the past about unleashing this technology on the world. In 2019, OpenAI decided not to release an earlier version of the underlying model that powers both ChatGPT and the new Bing because the company’s leaders deemed it too dangerous to do so, they said at the time.
  • ...26 more annotations...
  • Microsoft leaders felt “enormous urgency” for it to be the company to bring this technology to market, because others around the world are working on similar tech but might not have the resources or inclination to build it as responsibly, says Sarah Bird, a leader on Microsoft’s responsible AI team.
  • One common starting point for such models is what is essentially a download or “scrape” of most of the internet. In the past, these language models were used to try to understand text, but the new generation of them, part of the revolution in “generative” AI, uses those same models to create texts by trying to guess, one word at a time, the most likely word to come next in any given sequence.
  • Wide-scale testing gives Microsoft and OpenAI a big competitive edge by enabling them to gather huge amounts of data about how people actually use such chatbots. Both the prompts users input into their systems, and the results their AIs spit out, can then be fed back into a complicated system—which includes human content moderators paid by the companies—to improve it.
  • , being first to market with a chat-based AI gives these companies a huge initial lead over companies that have been slower to release their own chat-based AIs, such as Google.
  • rarely has an experiment like Microsoft and OpenAI’s been rolled out so quickly, and at such a broad scale.
  • Among those who build and study these kinds of AIs, Mr. Altman’s case for experimenting on the global public has inspired responses ranging from raised eyebrows to condemnation.
  • The fact that we’re all guinea pigs in this experiment doesn’t mean it shouldn’t be conducted, says Nathan Lambert, a research scientist at the AI startup Huggingface.
  • “I would kind of be happier with Microsoft doing this experiment than a startup, because Microsoft will at least address these issues when the press cycle gets really bad,” says Dr. Lambert. “I think there are going to be a lot of harms from this kind of AI, and it’s better people know they are coming,” he adds.
  • Others, particularly those who study and advocate for the concept of “ethical AI” or “responsible AI,” argue that the global experiment Microsoft and OpenAI are conducting is downright dangerous
  • Celeste Kidd, a professor of psychology at University of California, Berkeley, studies how people acquire knowledge
  • Her research has shown that people learning about new things have a narrow window in which they form a lasting opinion. Seeing misinformation during this critical initial period of exposure to a new concept—such as the kind of misinformation that chat-based AIs can confidently dispense—can do lasting harm, she says.
  • Dr. Kidd likens OpenAI’s experimentation with AI to exposing the public to possibly dangerous chemicals. “Imagine you put something carcinogenic in the drinking water and you were like, ‘We’ll see if it’s carcinogenic.’ After, you can’t take it back—people have cancer now,”
  • Part of the challenge with AI chatbots is that they can sometimes simply make things up. Numerous examples of this tendency have been documented by users of both ChatGPT and OpenA
  • These models also tend to be riddled with biases that may not be immediately apparent to users. For example, they can express opinions gleaned from the internet as if they were verified facts
  • When millions are exposed to these biases across billions of interactions, this AI has the potential to refashion humanity’s views, at a global scale, says Dr. Kidd.
  • OpenAI has talked publicly about the problems with these systems, and how it is trying to address them. In a recent blog post, the company said that in the future, users might be able to select AIs whose “values” align with their own.
  • “We believe that AI should be a useful tool for individual people, and thus customizable by each user up to limits defined by society,” the post said.
  • Eliminating made-up information and bias from chat-based search engines is impossible given the current state of the technology, says Mark Riedl, a professor at Georgia Institute of Technology who studies artificial intelligence
  • He believes the release of these technologies to the public by Microsoft and OpenAI is premature. “We are putting out products that are still being actively researched at this moment,” he adds. 
  • in other areas of human endeavor—from new drugs and new modes of transportation to advertising and broadcast media—we have standards for what can and cannot be unleashed on the public. No such standards exist for AI, says Dr. Riedl.
  • To modify these AIs so that they produce outputs that humans find both useful and not-offensive, engineers often use a process called “reinforcement learning through human feedback.
  • that’s a fancy way of saying that humans provide input to the raw AI algorithm, often by simply saying which of its potential responses to a query are better—and also which are not acceptable at all.
  • Microsoft’s and OpenAI’s globe-spanning experiments on millions of people are yielding a fire hose of data for both companies. User-entered prompts and the AI-generated results are fed back through a network of paid human AI trainers to further fine-tune the models,
  • Huggingface’s Dr. Lambert says that any company, including his own, that doesn’t have this river of real-world usage data helping it improve its AI is at a huge disadvantage
  • In chatbots, in some autonomous-driving systems, in the unaccountable AIs that decide what we see on social media, and now, in the latest applications of AI, again and again we are the guinea pigs on which tech companies are testing new technology.
  • It may be the case that there is no other way to roll out this latest iteration of AI—which is already showing promise in some areas—at scale. But we should always be asking, at times like these: At what price?
« First ‹ Previous 481 - 500 of 508 Next ›
Showing 20▼ items per page