facial-recognition-biases-and-racism
This article is also available here in Spanish.

Facial recognition and combating crime: why biases can lead to a justice system full of prejudices

My list

Author | Arantxa HerranzAn increasing number of cities are turning to facial recognition systems as a measure to combat crime. Moscow is one of the most recent, but before reaching the Russian capital, they could be found in cities such as Chicago or countries such as China. A measure that has had its fair share of controversy, since defenders of civic freedoms and privacy fear that technology will become a massive surveillance and, more importantly, a discriminatory weapon. Europe, in fact, is considering prohibiting the use of facial recognition systems in public spaces for five years, until measures are put in place designed, precisely, to prevent possible abuses.The problem is not so much whether this is an imperfect system (in china, for example, there is a certain degree of controversy since it was noted that at the entrance to buildings with facial recognition, people wearing masks to prevent the spread of the coronavirus are being denied access); part of the controversy is that facial recognition has significant racial, sexual and age biases.

Middle aged white men, the most recognisable

Researchers at the National Institute of Standards and Technology discovered that the facial recognition algorithms are much better with people described as white than with Afro-American or Asian people. So much so, that the errors in the identification of these people are 10 to 100 times more likely of failing than with Caucasian faces.In a database of photos used by police agencies in the United States, the highest error rates came in identifying Native Americans, according to the study. Furthermore, the algorithms had more difficulties in identifying women than men.To conduct this study, the agency tested around 200 facial recognition algorithms of around 100 developers, using four collections of photographs with over 18 million images of more than 8 million people.Facial recognition

Biases are maximised in artificial intelligence

The problem of biases is not new. And it is not the only one in artificial intelligence. But the main problem is that algorithms may, when badly programmed, maximise and increase these biases that affect people’s race, age, condition and sexual orientation or religion.And it not does not just affect facial recognition: a recent study also demonstrated that an algorithm widely used in hospitals in the US to assign medical care to patients has been systematically discriminating against black people.In many cases, AI can reduce the subjective interpretation of human data, since algorithms learn to only consider variables that improve their predictive accuracy, based on the training data used. Furthermore, there is significant evidence to suggest that AI models can embed human and social biases and deploy them at scale.Therefore, both humans and machines should strive to avoid biases and, with them, discrimination. Biases in AI occur mainly in data or algorithmic models, therefore the industry is looking to develop AI systems that we can trust. These systems therefore need to be trained with impartial data, developing algorithms that can be easily explained for possible analysis when false positives are identified.Images | Fauxels, teguhjatipras

Related content

Recommended profiles for you

RR
richevel Richard Knowlton
Oxford Cyber Academy
Director
EE
EYAL ENAV
NVIDIA
DR
Dinesh Kumar Rajendran
Highbrow Technology Inc
CB
claudi0 bernardes
Ingai Urbanismo
MI
Muhammad Ilham
Urban planner Banda Aceh City
MR
MINA RIAD
DAR GROUP
Senior Telecom Engineer
EL
Elvis Law
Axis Communications
Business Development Manager, Smart Cities
DC
Diógenes Casagrande
DC Best Consultoria Telecom
Director
JD
Joel Desouve
CO
Carlos Olsen
Global Business Innovation Intelligence
Developing innovation ecosystems and smart city projects.
SA
Shavi Arora
Network innovators
CTO
PC
Pharada Chan-arak
C-Link
JN
Jose Manuel Nobre
Gloone
Country Manager
AS
ajmal sayfullah
Rudram phronesis infraz pvt. ltd
AM
Alberto Mombelli
AXIS
Sales
HL
Helen Lee
AS
Andrea Sorri
Axis Communications
BDM
TS
Tricia Sim
Axis Communications
Business Development Manager, Smart Cities & Transportation
KA
Kosuke Akiba
Honda R&D Co., Ltd.
AK
AHMED KADAH
G4S Secure solution
Head of the electronic security systems department

Are we building the cities we really need?

Explore Cartography of Our Urban Future —a bold rethink of ‘smart’ cities and what we must change by 2030.