Group items tagged

"Twitter's image cropping algorithm prefers younger, slimmer faces with lighter skin, an investigation into algorithmic bias at the company has found. The finding, while embarrassing for the company, which had previously apologised to users after reports of bias, marks the successful conclusion of Twitter's first ever "algorithmic bug bounty"."

"The independent review on equity in medical devices once again highlights the multiple ways in which medical technology development can lead to solutions whereby the benefits are distributed inequitably across society, or can further exacerbate health inequalities (UK report reveals bias within medical tools and devices, 11 March). While the report is welcome, the challenge facing scientists and engineers is how to innovate medical devices differently to respond to longstanding societal biases and inequalities."

"Algorithms and the data that drive them are designed and created by people, which means those systems can carry biases based on who builds them and how they're ultimately deployed. Safiya Umoja Noble, author of Algorithms of Oppression: How Search Engines Reinforce Racism, offers a curated reading list exploring how technology can replicate and reinforce racist and sexist beliefs, how that bias can affect everything from health outcomes to financial credit to criminal justice, and why data discrimination is a major 21st century challenge."

"But it also raises uncomfortable questions: is AI technology helping marginalized people overcome bias, or just perpetuating the biases that make their lives hard in the first place?"

"The economist Oren Cass has a compelling answer for these concerns. He says they suffer from bias: the idea that this technological revolution is somehow unique, when we have lived through many epochs of innovation and upheaval. They also overestimate the pace of change (robots are a long way off from competing with humans in many areas) and assume that new kinds of jobs will not be created in the process."

"On inbuilt bias in algorithms, Sharkey said: "There are so many biases happening now, from job interviews to welfare to determining who should get bail and who should go to jail. It is quite clear that we really have to stop using decision algorithms, and I am someone who has always been very light on regulation and always believed that it stifles innovation."

"In each case, biometric data has been harnessed to try to save time and money. But the growing use of our bodies to unlock areas of the public and private sphere has raised questions about everything from privacy to data security and racial bias."

"Can AI ever be unbiased? As AI systems become more integrated into our daily lives, it's crucial that we understand the complexities of bias and how it impacts these technologies. From chatbots to hiring algorithms, the potential for AI to perpetuate and even amplify existing biases is a genuine concern. "

"There's an increasingly popular solution to this problem: why not let an intelligent algorithm make hiring decisions for you? Surely, the thinking goes, a computer is more able to be impartial than a person, and can simply look at the relevant data vectors to select the most qualified people from a heap of applications, removing human bias and making the process more efficient to boot."

""My concern is that a facial recognition rejection can [create] bias," said Rudolph. "So, if someone has a lot of faith in this technology and thinks that it's foolproof, and someone is rejected by this system, that customs officer or gate agent may be predisposed to saying this person is traveling with fraudulent credentials. That's a crime and a serious issue.""

"Facebook is mired in a series of controversies about the curation of its news feed, from its broadcasting live killings, to editing out an iconic photo of the Vietnam war, to accusations of political bias. It recently tried to smooth the process out by firing its human editors … only to find the news feed degenerated into a mass of fake and controversial news stories."

"To Lawmakers and School Administrators: As parents and caregivers, there is nothing more important to us than our children's safety. That's why we're calling for an outright ban on the use of facial recognition in schools. We're concerned about this technology spreading to our schools, infringing on our kids' rights and putting them in danger. We don't even know the psychological impacts this constant surveillance can have on our children, but we do know that violating their basic rights will create an environment of mistrust and will make it hard for students to succeed and grow. The images collected by this technology will become a target for those wishing to harm our children, and could put them in physical danger or at risk of having their biometric information stolen or sold. The well-known bias built into this technology will put Black and brown children, girls, and gender noncomforming kids in specific danger. Facial recognition creates more harm than good and should not be used on the children we have been entrusted to protect. It should instead be immediately banned."

"But users began to spot flaws in the feature over the weekend. The first to highlight the issue was PhD student Colin Madland, who discovered the issue while highlighting a different racial bias in the video-conference software Zoom. When Madland, who is white, posted an image of himself and a black colleague who had been erased from a Zoom call after its algorithm failed to recognise his face, Twitter automatically cropped the image to only show Madland."

"Twitter has admitted it amplifies more tweets from rightwing politicians and news outlets than content from leftwing sources. The social media platform examined tweets from elected officials in seven countries - the UK, US, Canada, France, Germany, Spain and Japan. It also studied whether political content from news organisations was amplified on Twitter, focusing primarily on US news sources such as Fox News, the New York Times and BuzzFeed."

"How that effects systems of governance has yet to be fully explored, but there are cautions. "Algorithms are only as good as the data on which they are based, and the problem with current AI is that it was trained on data that was incomplete or unrepresentative and the risk of bias or unfairness is quite substantial," says West. The fairness and equity of algorithms are only as good as the data-programming that underlie them. "For the last few decades we've allowed the tech companies to decide, so we need better guardrails and to make sure the algorithms respect human values," West says. "We need more oversight.""

"Countries around the world are deploying technologies-like digital IDs, facial recognition systems, GPS devices, and spyware-that are meant to improve governance and reduce crime. But there has been little evidence to back these claims, all while introducing a high risk of exclusion, bias, misidentification, and privacy violations. It's important to note that these impacts are not equal. They fall disproportionately on religious, ethnic, and sexual minorities, migrants and refugees, as well as human rights activists and political dissidents."

"What if facial recognition technology isn't as good at recognising faces as it has sometimes been claimed to be? If the technology is being used in the criminal justice system, and gets the identification wrong, this can cause serious problems for people (see Robert Williams' story in "Facing up to the problems of recognising faces")."

"Concerns have been growing about AI's so-called "white guy problem" and now scientists have devised a way to test whether an algorithm is introducing gender or racial biases into decision-making."

"A simple Google image search highlighted on Twitter has been said to highlight the pervasiveness of racial bias and media profiling. "Three black teenagers" was a trending search on Google on Thursday after a US high school student pointed out the stark difference in results for "three black teenagers" and "three white teenagers"."

"The paper, co-authored by researchers inside and outside Google, contended that technology companies could do more to ensure AI systems aimed at mimicking human writing and speech do not exacerbate historical gender biases and use of offensive language, according to a draft copy seen by Reuters."