Group items tagged

YouTube has inadvertently created a dangerous on-ramp to extremism by combining two things: a business model that rewards provocative videos with exposure and advertising dollars, and an algorithm that guides users down personalized paths meant to keep them glued to their screens

“If I’m YouTube and I want you to watch more, I’m always going to steer you toward Crazytown.”

94 percent of Americans ages 18 to 24 use YouTube, a higher percentage than for any other online service

YouTube has been a godsend for hyper-partisans on all sides. It has allowed them to bypass traditional gatekeepers and broadcast their views to mainstream audiences, and has helped once-obscure commentators build lucrative media businesses

Bellingcat, an investigative news site, analyzed messages from far-right chat rooms and found that YouTube was cited as the most frequent cause of members’ “red-pilling” — an internet slang term for converting to far-right beliefs

The internet was an escape. Mr. Cain grew up in postindustrial Appalachia and was raised by his conservative Christian grandparents. He was smart, but shy and socially awkward, and he carved out an identity during high school as a countercultural punk. He went to community college, but dropped out after three semesters. Broke and depressed, he resolved to get his act together. He began looking for help in the same place he looked for everything: YouTube.

they rallied around issues like free speech and antifeminism, portraying themselves as truth-telling rebels doing battle against humorless “social justice warriors.” Their videos felt like episodes in a long-running soap opera, with a constant stream of new heroes and villains. To Mr. Cain, all of this felt like forbidden knowledge — as if, just by watching some YouTube videos, he had been let into an exclusive club. “When I found this stuff, I felt like I was chasing uncomfortable truths,” he told me. “I felt like it was giving me power and respect and authority.”

YouTube’s executives announced that the recommendation algorithm would give more weight to watch time, rather than views. That way, creators would be encouraged to make videos that users would finish, users would be more satisfied and YouTube would be able to show them more ads.

A month after its algorithm tweak, YouTube changed its rules to allow all video creators to run ads alongside their videos and earn a portion of the revenue they generated.

Many right-wing creators already made long video essays, or posted video versions of their podcasts. Their inflammatory messages were more engaging than milder fare. And now that they could earn money from their videos, they had a financial incentive to churn out as much material as possible.

Several current and former YouTube employees, who would speak only on the condition of anonymity because they had signed confidentiality agreements, said company leaders were obsessed with increasing engagement during those years. The executives, the people said, rarely considered whether the company’s algorithms were fueling the spread of extreme and hateful political content.

Google Brain’s researchers wondered if they could keep YouTube users engaged for longer by steering them into different parts of YouTube, rather than feeding their existing interests. And they began testing a new algorithm that incorporated a different type of A.I., called reinforcement learning. The new A.I., known as Reinforce, was a kind of long-term addiction machine. It was designed to maximize users’ engagement over time by predicting which recommendations would expand their tastes and get them to watch not just one more video but many more.

YouTube’s recommendations system is not set in stone. The company makes many small changes every year, and has already introduced a version of its algorithm that is switched on after major news events to promote videos from “authoritative sources” over conspiracy theories and partisan content. This past week, the company announced that it would expand that approach, so that a person who had watched a series of conspiracy theory videos would be nudged toward videos from more authoritative news sources. It also said that a January change to its algorithm to reduce the spread of so-called “borderline” videos had resulted in significantly less traffic to those videos.

the bulk of his media diet came from far-right channels. And after the election, he began exploring a part of YouTube with a darker, more radical group of creators. These people didn’t couch their racist and anti-Semitic views in sarcastic memes, and they didn’t speak in dog whistles. One channel run by Jared Taylor, the editor of the white nationalist magazine American Renaissance, posted videos with titles like “‘Refugee’ Invasion Is European Suicide.” Others posted clips of interviews with white supremacists like Richard Spencer and David Duke.

As Mr. Molyneux promoted white nationalists, his YouTube channel kept growing. He now has more than 900,000 subscribers, and his videos have been watched nearly 300 million times. Last year, he and Ms. Southern — Mr. Cain’s “fashy bae” — went on a joint speaking tour in Australia and New Zealand, where they criticized Islam and discussed what they saw as the dangers of nonwhite immigration. In March, after a white nationalist gunman killed 50 Muslims in a pair of mosques in Christchurch, New Zealand, Mr. Molyneux and Ms. Southern distanced themselves from the violence, calling the killer a left-wing “eco-terrorist” and saying that linking the shooting to far-right speech was “utter insanity.” Neither Mr. Molyneux nor Ms. Southern replied to a request for comment. The day after my request, Mr. Molyneux uploaded a video titled “An Open Letter to Corporate Reporters,” in which he denied promoting hatred or violence and said labeling him an extremist was “just a way of slandering ideas without having to engage with the content of those ideas.”

Unlike most progressives Mr. Cain had seen take on the right, Mr. Bonnell and Ms. Wynn were funny and engaging. They spoke the native language of YouTube, and they didn’t get outraged by far-right ideas. Instead, they rolled their eyes at them, and made them seem shallow and unsophisticated.

“I noticed that right-wing people were taking these old-fashioned, knee-jerk, reactionary politics and packing them as edgy punk rock,” Ms. Wynn told me. “One of my goals was to take the excitement out of it.”

Ms. Wynn and Mr. Bonnell are part of a new group of YouTubers who are trying to build a counterweight to YouTube’s far-right flank. This group calls itself BreadTube, a reference to the left-wing anarchist Peter Kropotkin’s 1892 book, “The Conquest of Bread.” It also includes people like Oliver Thorn, a British philosopher who hosts the channel PhilosophyTube, where he posts videos about topics like transphobia, racism and Marxist economics.

The core of BreadTube’s strategy is a kind of algorithmic hijacking. By talking about many of the same topics that far-right creators do — and, in some cases, by responding directly to their videos — left-wing YouTubers are able to get their videos recommended to the same audience.

What is most surprising about Mr. Cain’s new life, on the surface, is how similar it feels to his old one. He still watches dozens of YouTube videos every day and hangs on the words of his favorite creators. It is still difficult, at times, to tell where the YouTube algorithm stops and his personality begins.

It’s possible that vulnerable young men like Mr. Cain will drift away from radical groups as they grow up and find stability elsewhere. It’s also possible that this kind of whiplash polarization is here to stay as political factions gain and lose traction online.

I’ve learned now that you can’t go to YouTube and think that you’re getting some kind of education, because you’re not.