Twitter apologises for ‘racist’ image-cropping algorithm
Users highlight examples of feature automatically focusing on white faces over black ones
Twitter users began to spot flaws in the feature over the weekend. Photograph: Glenn Chapman/AFP/Getty Images
Twitter has apologised for a “racist” image cropping algorithm, after users discovered the feature was automatically focusing on white faces over black ones.
The company says it had tested the service for bias before it started using it, but now accepts that it didn’t go far enough.
Twitter has long automatically cropped images to prevent them taking up too much space on the main feed, and to allow multiple pictures to be shown in the same tweet. The company uses several algorithmic tools to try to focus on the most important parts of the picture, trying to ensure that faces and text remain in the cropped part of an image.
But users began to spot flaws in the feature over the weekend. The first to highlight the issue was PhD student Colin Madland, who discovered the issue while highlighting a different racial bias in the video-conference software Zoom.
When Madland, who is white, posted an image of himself and a black colleague who had been erased from a Zoom call after its algorithm failed to recognise his face, Twitter automatically cropped the image to only show Madland.
Others followed up with more targeted experiments, including entrepreneur Tony Arcieri, who discovered that the algorithm would consistently crop an image of US senator Mitch McConnell and Barack Obama to hide the former president.
Advertisement
Similar outcomes were found for stock photo models, Simpsons characters Lenny and Carl, and even golden labradors and black labradors.
Jef Caine(@JefCaine)
Jordan Simonovski(@_jsimonovski)
I wonder if Twitter does this to fictional characters too.
Lenny Carl pic.twitter.com/fmJMWkkYEf
- M A R K -(@MarkEMarkAU)
I tried it with dogs. Let’s see. pic.twitter.com/xktmrNPtid
In a statement, a Twitter spokesperson admitted the company had work to do. “Our team did test for bias before shipping the model and did not find evidence of racial or gender bias in our testing. But it’s clear from these examples that we’ve got more analysis to do. We’ll continue to share what we learn, what actions we take, and will open source our analysis so others can review and replicate.”
Twitter is by no means the first technology firm to find itself struggling to explain apparent racial bias in its algorithms. In 2018, it was revealed that Google had simply banned its Photos service from ever labelling anything as a gorilla, chimpanzee, or monkey, after the company had come under fire for repeatedly mislabelling images of black people with those racist terms.
The conversation on race …
… is just getting started. People all across the world have taken a stand against police violence and racism, and the Guardian stands in solidarity with the struggle for truth, humanity and justice. We believe that our role is to present the facts, report on events first-hand, and provide an open, inclusive platform for the voices of ethnic minorities to be heard by millions.
2020 has clearly shown us that police brutality unfairly targets black people, and we’ve witnessed the racial inequalities of Covid-19 — from the scale of the loss of life, to the catastrophic economic consequences for individuals and businesses. We’re committed to helping tell the stories that need to be told, from people who deserve to be listened to. With your support, we can intensify our ambitions.
Millions are flocking to the Guardian for quality news every day. We believe everyone deserves access to factual information, and analysis that has authority and integrity. That’s why, unlike many others, we made a choice: to keep Guardian reporting open for all, regardless of where they live or what they can afford to pay.
As an open, independent news organisation we investigate, interrogate and expose the actions of those in power, without fear. With no shareholders or billionaire owner, our journalism is free from political and commercial bias — this makes us different. We can give a voice to the oppressed and neglected, and stand in solidarity with those who are calling for a fairer future. With your help we can make a difference.
We’re determined to provide journalism that helps each of us better understand the world, and take actions that challenge, unite, and inspire change — in times of crisis and beyond. Our work would not be possible without our readers, who now support our work from 180 countries around the world.
