Warnings AI tools used by government on UK public are ‘racist and biased’

Artificial intelligence and algorithmic tools used by central government are to be published on a public register after warnings they can contain “entrenched” racism and bias.

Officials confirmed this weekend that tools challenged by campaigners over alleged secrecy and a risk of bias will be named shortly. The technology has been used for a range of purposes, from trying to detect sham marriages to rooting out fraud and error in benefit claims.

The move is a victory for campaigners who have been challenging the deployment of AI in central government in advance of what is likely to be a rapid rollout of the technology in the public sector.

Caroline Selman, a senior research fellow at the Public Law Project (PLP), an access-to-justice charity, said there had been a lack of transparency on the existence, details and deployment of the systems. “We need to make sure public bodies are publishing the information about these tools, which are being rapidly rolled out. It is in everyone’s interest that the technology which is adopted is lawful, fair and non-discriminatory.”

The last government said in a consultation response on AI regulation in February that departments would be mandated to comply with the reporting standard. The Department for Science, Innovation and Technology (DSIT) confirmed that departments would now report on use of the technology under the standard.

A DSIT spokesperson said: “Technology has huge potential to improve public services, but we know it’s important to maintain the right safeguards including, where appropriate, human oversight and other forms of governance.

“The algorithmic transparency recording standard is now mandatory for all departments, with a number of records due to be published shortly. We continue to explore how it can be expanded across the public sector. We encourage all organisations to use AI and data in a way that builds public trust through tools, guidance and standards.”

Read full story

Source: The Guardian, 25 August 2024