facial-recognition-biases-and-racism
This article is also available here in Spanish.

Facial recognition and combating crime: why biases can lead to a justice system full of prejudices

My list

Author | Arantxa HerranzAn increasing number of cities are turning to facial recognition systems as a measure to combat crimeMoscow is one of the most recent, but before reaching the Russian capital, they could be found in cities such as Chicago or countries such as China. A measure that has had its fair share of controversy, since defenders of civic freedoms and privacy fear that technology will become a massive surveillance and, more importantly, a discriminatory weapon. Europe, in fact, is considering prohibiting the use of facial recognition systems in public spaces for five years, until measures are put in place designed, precisely, to prevent possible abuses.The problem is not so much whether this is an imperfect system (in china, for example, there is a certain degree of controversy since it was noted that at the entrance to buildings with facial recognition, people wearing masks to prevent the spread of the coronavirus are being denied access); part of the controversy is that facial recognition has significant racial, sexual and age biases.

Middle aged white men, the most recognisable

Researchers at the National Institute of Standards and Technology discovered that the facial recognition algorithms are much better with people described as white than with Afro-American or Asian people. So much so, that the errors in the identification of these people are 10 to 100 times more likely of failing than with Caucasian faces.In a database of photos used by police agencies in the United States, the highest error rates came in identifying Native Americans, according to the study. Furthermore, the algorithms had more difficulties in identifying women than men.To conduct this study, the agency tested around 200 facial recognition algorithms of around 100 developers, using four collections of photographs with over 18 million images of more than 8 million people.Facial recognition

Biases are maximised in artificial intelligence

The problem of biases is not new. And it is not the only one in artificial intelligence. But the main problem is that algorithms may, when badly programmed, maximise and increase these biases that affect people’s race, age, condition and sexual orientation or religion.And it not does not just affect facial recognition: a recent study also demonstrated that an algorithm widely used in hospitals in the US to assign medical care to patients has been systematically discriminating against black people.In many cases, AI can reduce the subjective interpretation of human data, since algorithms learn to only consider variables that improve their predictive accuracy, based on the training data used. Furthermore, there is significant evidence to suggest that AI models can embed human and social biases and deploy them at scale.Therefore, both humans and machines should strive to avoid biases and, with them, discrimination. Biases in AI occur mainly in data or algorithmic models, therefore the industry is looking to develop AI systems that we can trust. These systems therefore need to be trained with impartial data, developing algorithms that can be easily explained for possible analysis when false positives are identified.Images | Fauxels, teguhjatipras

Related content

Recommended profiles for you

FM
Fatemeh Mohammadi
Arastoo
Operator
AS
Andy Smeets
NMB MinebeaMitsumi
Sales Engineer
ED
ENRIQUE DE OLANO
WEBCN
MI
Muslika Ikha
-
Student
AS
ajmal sayfullah
Rudram phronesis infraz pvt. ltd
IG
Indiana Gqwede
City of Cape Town
CD
Catalina Dominguez
Municipalidad de Las Condes
AB
Alejandro Luis Buzó Gutierrez
Municipalidad de Asunción
Director, de la Dirección de Prevención de Incendios de la Municipalidad de Asunción.
AG
Alonzo Gutierrez
UTP
WB
Wissam Benmusa
Libyan petroleum institute
Supervisor of the Monitoring and Electronic Control Unit
EZ
Elnaz ZarghamiSoltanAhmadi
MM
Miriam Ratih Handayani Miriam
Universitas Jenderal Soedirman
EE
EYAL ENAV
NVIDIA
JC
Jorge Córdova
CityShob
Integrator
LC
Leonardo Campanale
Associazione Nazionale Controllo di Vicinato
President
DS
Dalibor Smazinka
Axis Communications
BDM
CG
Christian Alejandro Gutiérrez Capucho
n
MM
Marcos Cruz Molina Marcos
Municipio Vega Baja
IE
InCrispin Elayron Jr
Reservist/941 marine reserve
Community organizing and training
AK
Alexander Kurtynin
Breeze Traffic

Are we building the cities we really need?

Explore Cartography of Our Urban Future —a bold rethink of ‘smart’ cities and what we must change by 2030.