Group items tagged

"A widely used algorithm that predicts which patients will benefit from extra medical care dramatically underestimates the health needs of the sickest black patients, amplifying long-standing racial disparities in medicine, researchers have found."

"On inbuilt bias in algorithms, Sharkey said: "There are so many biases happening now, from job interviews to welfare to determining who should get bail and who should go to jail. It is quite clear that we really have to stop using decision algorithms, and I am someone who has always been very light on regulation and always believed that it stifles innovation."

"O'Neill recounts an exercise to improve service to homeless families in New York City, in which data-analysis was used to identify risk-factors for long-term homelessness. The problem, O'Neill describes, was that many of the factors in the existing data on homelessness were entangled with things like race (and its proxies, like ZIP codes, which map extensively to race in heavily segregated cities like New York). Using data that reflects racism in the system to train a machine-learning algorithm whose conclusions can't be readily understood runs the risk of embedding that racism in a new set of policies, these ones scrubbed clean of the appearance of bias with the application of objective-seeming mathematics. "

"Specifically, the question is whether that algorithm is sorting suggestions based on the race of the creator - something TikTok denies it's doing intentionally. But it's another example of the need for more scrutiny into how the app and other social media platforms promote particular creators or content."

"These systems weren't set up to be biased; it's likely that they were simply trained on a subset of the diversity of accents and usages present in the United States. But, as we become ever more reliant on these systems, making them less frustrating for all their users should be a priority."

"But users began to spot flaws in the feature over the weekend. The first to highlight the issue was PhD student Colin Madland, who discovered the issue while highlighting a different racial bias in the video-conference software Zoom. When Madland, who is white, posted an image of himself and a black colleague who had been erased from a Zoom call after its algorithm failed to recognise his face, Twitter automatically cropped the image to only show Madland."

"In each case, biometric data has been harnessed to try to save time and money. But the growing use of our bodies to unlock areas of the public and private sphere has raised questions about everything from privacy to data security and racial bias."

"Concerns have been growing about AI's so-called "white guy problem" and now scientists have devised a way to test whether an algorithm is introducing gender or racial biases into decision-making."

"A simple Google image search highlighted on Twitter has been said to highlight the pervasiveness of racial bias and media profiling. "Three black teenagers" was a trending search on Google on Thursday after a US high school student pointed out the stark difference in results for "three black teenagers" and "three white teenagers"."

"A Taiwanese American model says a well-known fashion designer uploaded a digitally altered runway photo that made her appear white. In a TikTok about the incident that has been viewed 1.8m times in the last week, Shereen Wu says Michael Costello, a designer who has worked with Beyoncé, Jennifer Lopez, and Celine Dion, posted a photo to his Instagram from a recent Los Angeles fashion show. The photo depicts Wu in the slinky black ballgown that she walked the runway in - but her face has been changed, made to appear as if she is a white woman."