UK Police Forces Lobbied to Use Biased Facial Recognition Technology
Law enforcement agencies across the United Kingdom successfully lobbied to deploy a face scanning system known to be discriminatory against females, young people, and individuals from minority ethnic backgrounds, after complaining that a more accurate version produced fewer potential suspects.
The Technology in Practice
UK forces utilize the police national database (PND) to carry out searches using historical face recognition. This process entails matching a reference photograph of a suspect against a repository of more than 19 million custody photos to find possible hits.
Acknowledged Discrimination
The Home Office admitted last week that the technology was flawed. This acknowledgment followed a review by the National Physical Laboratory (NPL) found it incorrectly matched Black and Asian people and women at much greater frequency than white men. The Home Office stated it “took steps on the findings”.
“It prompts the question of whether facial recognition only becomes effective if users tolerate discrimination in ethnicity and sex. Operational ease is a poor argument for disregarding basic freedoms.”
Known Issue
Internal documents show that this bias has been recognized for over twelve months. Furthermore, police forces lobbied to reverse an earlier ruling that was intended to mitigate the problem.
Senior officers were notified of the algorithmic discrimination in late 2024. The government-ordered NPL review found the system was had a higher probability to suggest false positives for photos of females, individuals of Black ethnicity, and those aged 40 and under.
A Reversed Decision
In reaction, the national police leadership body ordered that the accuracy setting required for possible hits be raised to a point where the disparity was greatly diminished.
However, this directive was reversed the following month following complaints from police that the adjusted system was producing a lower number of “useful lines of inquiry”. Internal records show the higher threshold cut the proportion of searches resulting in possible identifications from 56% to a mere under 15%.
Profound Inequalities
Although the Home Office and NPCC declined to specify what threshold is now in operation, the recent NPL study found the system could generate incorrect matches for women of Black heritage nearly a hundred times more frequently than for Caucasian women at specific configurations.
The Home Office commented on these results: “Our evaluation found that in a limited set of circumstances the algorithm is has a greater tendency to wrongly flag some population segments in its match reports.”
Operational Effectiveness vs. Bias
Describing the impact of the temporary raise to the system's confidence threshold, the police records note: “The change significantly reduces the effect of bias across protected characteristics of ethnicity, generation and gender but had a substantially detrimental effect on operational effectiveness”. The documents further note that police units complained that “a once effective tactic now delivered results of questionable value”.
Wider Implementation Proposals
Meanwhile, the UK administration has launched a two-and-a-half-month consultation on its plans to expand the use of biometric scanning systems. The minister for police the relevant minister has labeled the technology as the “biggest breakthrough since DNA matching”.
Criticism from Advisors and Monitors
The chair of a police oversight board, head of the independent scrutiny and oversight board for the police race action plan, commented: “We observed very little consideration in race action plan meetings of the facial recognition rollout despite obvious cross-over with the strategy's goals.
“This disclosure demonstrate yet again that the pledges to combat discrimination the police has made via the equality initiative are failing to be integrated into wider practice. Our reports have warned that new technologies are being implemented in a context where ethnic inequalities, weak scrutiny and faulty information gathering already persist.
“All deployment of facial recognition must meet strict national standards, be subject to external review, and demonstrate it reduces rather than exacerbates ethnic bias.”
Home Office Response
A government representative said: “We treat the conclusions of the report with utmost gravity and we have already taken action. A new algorithm has been externally evaluated and acquired, which has demonstrated no measurable discrimination. It will be tested early next year and will be undergo evaluation.
“Our priority is protecting the public. This revolutionary tool will assist officers to apprehend and prosecute offenders. There is human involvement in each stage of the procedure and no arrest or charge would be taken without trained officers meticulously examining the output.”