Group items tagged

the justice system continues to be slow to understand the link between online harassment and real-life violence

In order to increase public safety this decade, it is imperative that police — and everyone else — become more familiar with the kinds of communities that engender toxic, militant systems of harassment, and the online and offline spaces where these communities exist. Increasingly, that means understanding social media’s dark corners, and the types of extremism they can foster.

Businesses have to learn when online outrage is manufactured

There’s a difference between organic outrage that arises because an employee actually does something outrageous, and invented outrage that’s an excuse to harass someone whom a group has already decided to target for unrelated reasons — for instance, because an employee is a feminist. A responsible business would ideally figure out which type of outrage is occurring before it punished a client or employee who was just doing their job.

Social media platforms didn’t learn how to shut down disingenuous conversations over ethics and free speech before they started to tear their cultures apart

Dedication to free speech over the appearance of bias is especially important within tech culture, where a commitment to protecting free speech is both a banner and an excuse for large corporations to justify their approach to content moderation — or lack thereof.

Reddit’s free-speech-friendly moderation stance resulted in the platform tacitly supporting pro-Gamergate subforums like r/KotakuInAction, which became a major contributor to Reddit’s growing alt-right community. Twitter rolled out a litany of moderation tools in the wake of Gamergate, intended to allow harassment targets to perpetually block, mute, and police their own harassers — without actually effectively making the site unwelcome for the harassers themselves. And YouTube and Facebook, with their algorithmic amplification of hateful and extreme content, made no effort to recognize the violence and misogyny behind pro-Gamergate content, or police them accordingly.

All of these platforms are wrestling with problems that seem to have grown beyond their control; it’s arguable that if they had reacted more swiftly to slow the growth of the internet’s most toxic and misogynistic communities back when those communities, particularly Gamergate, were still nascent, they could have prevented headaches in the long run — and set an early standard for how to deal with ever-broadening issues of extremist content online.

Violence against women is a predictor of other kinds of violence. We need to acknowledge it.

Somehow, the idea that all of that sexism and anti-feminist anger could be recruited, harnessed, and channeled into a broader white supremacist movement failed to generate any real alarm, even well into 2016

many of the perpetrators of real-world violence are radicalized online first

It remains difficult for many to accept the throughline from online abuse to real-world violence against women, much less the fact that violence against women, online and off, is a predictor of other kinds of real-world violence

Politicians and the media must take online “ironic” racism and misogyny seriously

Gamergate masked its misogyny in a coating of shrill yelling that had most journalists in 2014 writing off the whole incident as “satirical” and immature “trolling,” and very few correctly predicting that Gamergate’s trolling was the future of politics

Gamergate was all about disguising a sincere wish for violence and upheaval by dressing it up in hyperbole and irony in order to confuse outsiders and make it all seem less serious.

Gamergate simultaneously masqueraded as legitimate concern about ethics that demanded audiences take it seriously, and as total trolling that demanded audiences dismiss it entirely. Both these claims served to obfuscate its real aim — misogyny, and, increasingly, racist white supremacy

The public’s failure to understand and accept that the alt-right’s misogyny, racism, and violent rhetoric is serious goes hand in hand with its failure to understand and accept that such rhetoric is identical to that of President Trump

deploying offensive behavior behind a guise of mock outrage, irony, trolling, and outright misrepresentation, in order to mask the sincere extremism behind the message.

many members of the media, politicians, and members of the public still struggle to accept that Trump’s rhetoric is having violent consequences, despite all evidence to the contrary.

The movement’s insistence that it was about one thing (ethics in journalism) when it was about something else (harassing women) provided a case study for how extremists would proceed to drive ideological fissures through the foundations of democracy: by building a toxic campaign of hate beneath a veneer of denial.

Gingrich subsequently secured a job for Pournelle’s son with Congressman Dana Rohrabacher in 1994, who like Gingrich is now a stalwart space booster and Trump supporter.

What Trump does is less important than the fact that he kicks over the table, strengthening America’s military state while demolishing bureaucracy and ignoring niceties. Democracy and law matter less than security and innovation

with communism a fading threat by the late 80’s, Gingrich shifted his focus to the specter of a new enemy, arguing in 1989 that “Islamic extremism may well be the greatest threat to Western values and Western security in the world.” Such fear-mongering—Islamic extremism remains a fraction as destructive as the nuclear Soviet Union—may seem ill-suited to optimism in mankind’s future, but as a political project it can be uncannily effective. Pournelle wrote that Islam demands adherence to a principle of “Islam or the sword,” and that an aggressive military response is not only justified but demanded: we are at war with the Caliphate.

Gingrich and Pournelle’s enthusiasm had less to do with Trump’s particular ambitions than with his capacity for destruction of the status quo. Much of the chaos Trump foments is, to Gingrich and Pournelle, a key feature to induce the future they want—the one where the feminists and “eco-terrorists” and university professors are soundly defeated

In their science fiction as in life, Gingrich and Pournelle shared an optimistic belief in power of technology—and an equally powerful insistence on the inevitability of conflict. They believed this required a robust, authoritarian state apparatus to preserve order and bind citizens together. Indeed, while backing Reagan, Gingrich had promoted a techno-futurism that was less conservative than it was authoritarian: he called for pruning inefficiency while aggressively promoting expansion and military technology. For his part, Pournelle published anthologies of science-fiction and techno-military essays through the 1980s under the name There Will Be War.

No science-fiction writer since has exerted as significant a political influence as Pournelle. But Pournelle does have a spiritual successor in Castalia House, the independent science-fiction publisher run by white nationalist Theodore Beale, aka Vox Day. Beale, like Gingrich, has said that his job is to save Western Civilization—and that it is in dire need of saving. Beale, however, is far more explicit about race.

Pournelle has dissociated himself from Beale’s politics, but Castalia House’s republishing of Pournelle’s 1980s There Will Be War series (as well as publishing a new volume 10) is no mere coincidence. Rather, they are indications of a shared worldview. To these writers, civil rights, equality, and civil liberties are irritants and impediments to progress at best. At worst, they are impositions on the holy forces of the market and social Darwinism (“evolution in action”) that sort out the best from the rest. And to all of them, the best tend to be white (with a bit of space for “the good ones” of other races). If there has been a shift in thought between the 1970s and today, it’s that the expected separation of wheat from chaff hasn’t taken place, and so now more active measures need to be taken—building the border walls and deportations, for example. Trump is an agent of these active measures—an agent of revolution, or at least the destruction that precedes a revolution.

Trump was far from the first to eliminate the line between right-wing thought and outright bigotry.

The articles and videos I first found all backed up what I was seeing on Reddit—posts that asserted a skewed version of actual reality, using carefully selected, out-of-context, and dubiously sourced statistics that propped up a hateful world view. On top of that, my online results were heavily influenced by something called an algorithm. I understand algorithms to be secretive bits of code that a website like YouTube will use to prioritize content that you are more likely to click on first. Because all of the content I was reading or watching was from far-right sources, all of the links that the algorithms dangled on my screen for me to click were from far-right perspectives.

I spent months isolated in my room, hunched over my computer, removing and approving memes on Reddit and watching conservative “comedians” that YouTube served up to me.

The inflammatory language and radical viewpoints used by the alt-right worked to YouTube and Google’s favor—the more videos and links I clicked on, the more ads I saw, and in turn, the more ad revenue they generated.

the biggest step in my recovery came when I attended a pro-Trump rally in Washington, D.C., in September 2017, about a month after the “Unite the Right” rally in Charlottesville, Virginia

The difference between the online persona of someone who identifies as alt-right and the real thing is so extreme that you would think they are different people. Online, they have the power of fake and biased news to form their arguments. They sound confident and usually deliver their standard messages strongly. When I met them in person at the rally, they were awkward and struggled to back up their statements. They tripped over their own words, and when they were called out by any counter protestors in the crowd, they would immediately use a stock response such as “You’re just triggered.”

Seeing for myself that the people I was talking to online were weak, confused, and backwards was the turning point for me.

we’re too far gone to reverse the damage that the alt-right has done to the internet and to naive adolescents who don’t know any better—children like the 13-year-old boy I was. It’s convenient for a massive internet company like Google to deliberately ignore why people like me get misinformed in the first place, as their profit-oriented algorithms continue to steer ignorant, malleable people into the jaws of the far-right

Dylann Roof, the white supremacist who murdered nine people in a Charleston, South Carolina, church in 2015, was radicalized by far-right groups that spread misinformation with the aid of Google’s algorithms.

Over the past couple months, I’ve been getting anti-immigration YouTube ads that feature an incident presented as a “news” story, about two immigrants who raped an American girl. The ad offers no context or sources, and uses heated language to denounce immigration and call for our county to allow ICE to seek out illegal immigrants within our area. I wasn’t watching a video about immigration or even politics when those ads came on; I was watching the old Monty Python “Cheese Shop” sketch. How does British satire, circa 1972, relate to America’s current immigration debate? It doesn’t.

tech companies need to be held accountable for the radicalization that results from their systems and standards.

anyone can be manipulated like I was. It’s so easy to find information online that we collectively forget that so much of the content the internet offers us is biased