Oxford Insights

Understanding racial bias in natural language processing

Our research into racial bias in natural language processing found that, in its current form, introducing natural language processing in government risks excluding the needs and opinions of people of colour.

We reviewed the current academic literature and interviewed experts in natural language processing. We concluded that, should governments widely adopt natural language processing systems, there is a risk of racial bias in three areas: racial prejudices found in language in training data; weaknesses in filters designed to catch racist language; algorithms’ inability to handle linguistic variation.

Oxford Insights_Racial Bias in Natural Language Processing

pdf - 1 MB

Projects

More Projects

Oxford Insights

The geopolitics of data governance: Data governance regimes

Oxford Insights

Using AI, big data, and open data for anti-corruption

Department for Digital, Culture, Media & Sport

Understanding AI R&D commercialisation

Oxford Insights

Ensuring inclusive secondary education in an AI age

Oxford Insights

Human-Centred Public Services Index 2022

Innovate UK

Measuring the UK’s immersive economy

Government Digital Service

Gender Equality and Social Inclusion in ICT Procurement: Discovery Report

Oxford Insights

An assessment framework for measuring government AI readiness

Open Contracting Partnership

Global procurement responses to Covid-19

Oxford Insights

Artificial intelligence and the new worlds of protest, revolution, and digital interventionism

Open Contracting Partnership

Gender Equality and Social Inclusion in Public Procurement: Qualitative Framework

CAF Development Bank of Latin America

Benchmarking the GovTech maturity of Ibero-American cities

Open Data Institute

How can regulators, industry bodies, and professional bodies create trust in data?

Ministerio de Tecnologías de la Información y las Comunicaciones

Designing a data sharing pilot for the Colombian government

United Nations Development Programme

Building UNDP’s AI Readiness Assessment tool

Intel

Evaluation of the Intel® AI for Youth Program

Government Digital Service

Exploring service improvements for Tell Us Once

Oxford Insights

AI for Climate Change

Oxford Insights

Trustworthy AI Self Assessment

Extractive Industries Transparency Initiative and Open Ownership

Evaluating beneficial ownership transparency programmes

Govtech 4 Impact World Congress

Ministry of Justice

Helping probation officers use data to make recall decisions

Movement to Work

Quantifying Movement to Work’s impact

CAF

Evaluating GovTech ecosystems across Ibero-America

Department for Work and Pensions

Understanding DWP’s data practices

Administrative Data Research UK

Measuring the benefits of administrative data linkage

Government of Kenya & United Nations Development Programme

Building AI capacity in the Kenyan public sector

Identifying risks in public contracts: Generative AI and the Company Analysis Tool

Ministry of Justice

Connecting people with bail accommodation to reduce pressure on prisons

Liverpool Civic Data Cooperative

Valuing the Liverpool Civic Data Cooperative’s data linkage work

Sport England

Getting the nation moving: How a Data & AI Lab transformed Sport England’s data culture

Department of Health and Social Care

DHSC Compass: Helping the NHS to buy better medtech

Ofgem

Comparing AI adoption across UK regulators

Open Contracting Partnership

Evaluating the OCP’s open contracting programme

Department of Health and Social Care

Designing a gambling-related harms prevention reporting platform for the DHSC