Group items tagged

""Weapons of math destruction" is how the writer Cathy O'Neil describes the nasty and pernicious kinds of algorithms that are not subject to the same challenges that human decision-makers are. Parole algorithms (not Jure's) can bias decisions on the basis of income or (indirectly) ethnicity. Recruitment algorithms can reject candidates on the basis of mistaken identity. In some circumstances, such as policing, they might create feedback loops, sending police into areas with more crime, which causes more crime to be detected."

"Other far more sinister real-world effects of algorithms are well documented. In the US, pedestrians have been mowed down by robotaxis; prisoners denied bail on the advice, in part, of software; in Australia, welfare recipients incorrectly and illegally hounded by an algorithmic debt collector that came to be known as robodebt. In the UK, students took to the streets in 2020 after being denied places at universities by the calculations of digital minions - their chants of "fuck the algorithm" proving a "defining moment" for Kowalkiewicz and an inspiration for his book."

"In October 2016, algorithms reacted to negative news headlines about Brexit negotiations by sending the pound down 6% against the dollar in under two minutes, before recovering almost immediately. Knowing which particular headline, or which particular algorithm, caused the crash is next to impossible. When one haywire algorithm started placing and cancelling orders that ate up 4% of all traffic in US stocks in October 2012, one commentator was moved to comment wryly that "the motive of the algorithm is still unclear"."

"When Google's algorithms result in men on the Internet seeing better-paying job advertisements than women, it's worth looking under the hood at the assumptions that the algorithms, and the people behind it, have made. "

"Algorithms and the data that drive them are designed and created by people, which means those systems can carry biases based on who builds them and how they're ultimately deployed. Safiya Umoja Noble, author of Algorithms of Oppression: How Search Engines Reinforce Racism, offers a curated reading list exploring how technology can replicate and reinforce racist and sexist beliefs, how that bias can affect everything from health outcomes to financial credit to criminal justice, and why data discrimination is a major 21st century challenge."

"Creating an algorithm that discriminates or shows bias isn't as hard as it might seem, however. As a first-year graduate student, my advisor asked me to create a machine-learning algorithm to analyze a survey sent to United States physics instructors about teaching computer programming in their courses."

"Those changes happened relatively slowly, but it seems to me that employment disruption is accelerating. A large reason for this is that what used to be a room-sized super computer now fits in my pocket. Over the last two decades, I have observed a fundamental change in how we can apply advanced algorithms to sensing and controlling systems-the kinds of technology that enable more sophisticated robotic manufacturing. I can remember discussing various algorithms and believing they were well beyond what we could ever implement. Now these same algorithms are considered elementary. They are just some of the changes that have fueled the revolution in manufacturing."

"This affects all of us every single day. When the algorithms that govern increasingly large parts of our lives have been designed almost exclusively by young bro-grammers with homogeneous experiences and worldviews, those algorithms are going to fail significant sections of society. A heartbreaking example of this is Gillian Brockell's experience of continuing to get targeted by pregnancy-related ads on Facebook after the stillbirth of her son. Brockell, a Washington Post journalist, recently made headlines when she tweeted an open letter to big tech companies, imploring them to think more carefully about how they target parenting ads."

"Admission algorithms can make or break your academic plans. A Washington Post investigation found 44 schools use prediction software to give applicants a score out of 100 for its admissions process. The score considers different aspects of a student's application from test scores, home address, transcripts, and even what websites they've visited. That's all calculated to rate how strong of a match a student is for a school."

"built an algorithm that can determine with 90 percent accuracy whether a person is drunk or not based on an infrared image of his or her face."

"The founders of Predictim want to be clear with me: Their product-an algorithm that scans the online footprint of a prospective babysitter to determine their "risk" levels for parents-is not racist. It is not biased. "We take ethics and bias extremely seriously," Sal Parsa, Predictim's CEO, tells me warily over the phone. "In fact, in the last 18 months we trained our product, our machine, our algorithm to make sure it was ethical and not biased. We took sensitive attributes, protected classes, sex, gender, race, away from our training set. We continuously audit our model. And on top of that we added a human review process.""

"Early Saturday morning after hours of negotiations, the bloc agreed on the broad terms of the Digital Services Act, or DSA, which will force tech companies to take greater responsibility for content that appears on their platforms. New obligations include removing illegal content and goods more quickly, explaining to users and researchers how their algorithms work, and taking stricter action on the spread of misinformation. Companies face fines of up to six percent of their annual turnover for non-compliance. "

"In a survey of more than 4,200 people conducted by CAA, travelers most frequently cited being split from their party while traveling on Ryanair, but the airline insists that it doesn't employ a family-splitting algorithm. Ryanair says if a person doesn't pay for their seat assignment, they are "randomly" assigned, which may result in them not sitting with their party."

"The Cyberspace Administration of China (CAC) unveiled a 30-point draft proposal for "algorithm recommendation management regulations" that would directly affect companies including ByteDance, Tencent Holdings and Kuaishou Technology. The rules would forbid practices that "encourage addiction or high consumption", as well as any activities that endanger national security or disrupt social and economic order."

"Among other things, the declaration states that military AI needs to be developed according to international laws, that nations should be transparent about the principles underlying their technology, and that high standards are implemented for verifying the performance of AI systems. It also says that humans alone should make decisions around the use of nuclear weapons."

"After being set an overarching goal like maximizing profit, they develop their own strategies based on experience of the market, often with little human oversight. The most advanced also use forms of AI whose workings are opaque even if humans wanted to peer inside."

"Not everything is so straightforward in Google land, as Google's chat protocols Hangouts and Talk, suffered a privacy issue on the 26 September that saw instant messages routed to unintended recipients."

"Having a site that is friendly to mobile browsers on smartphones and tablets will be key from Tuesday as Google rolls out a new mobile-focused algorithm. The update to the way Google ranks search results will take into account how mobile-friendly a website is. This means companies without a good mobile website will suffer, as searchers on mobile will see sites with good mobile experiences ranked higher than those with no mobile or poor mobile sites."

"YouTube will rely more on machine learning and less on human reviewers during the coronavirus outbreak. Normally, algorithms detect potentially harmful content and send it to human reviewers for assessment. But these are not normal times, and in an effort to reduce the need for employees and contractors to come into an office, YouTube will allow its automated system to remove some content without human review."

"MEETINGS ON ZOOM, the increasingly popular video conferencing service, are encrypted using an algorithm with serious, well-known weaknesses, and sometimes using keys issued by servers in China, even when meeting participants are all in North America, according to researchers at the University of Toronto."