A UK government watchdog is weighing a formal investigation into the Home Office over its deployment of generative artificial intelligence to handle asylum applications. The Independent Chief Inspector of Borders and Immigration has begun gathering evidence from digital rights advocates following mounting concerns regarding the accuracy of these systems and a perceived lack of transparency from the government. At the center of the controversy are tools built on OpenAI’s GPT-4 technology designed to summarize witness interviews and sift through complex country policy data to help officials manage a massive backlog of cases.
While the Home Office maintains that these tools merely assist human caseworkers rather than replacing them, critics argue that the stakes are far too high for such reliance on software prone to hallucinations. Recent reports suggest that the error rate for AI-generated summaries may be significantly higher than official figures indicate, leading to fears that factual mistakes could result in life-altering decisions. These worries were underscored by a recent court case in which a judge accused the department of using an AI-hallucinated document to justify denying asylum to a mother and child from Morocco.
Beyond technical glitches, lawmakers and activists are raising alarms about ingrained cultural biases within large language models that could strip away critical nuance from refugees’ testimonies. Member of Parliament Bell Ribeiro-Addy expressed deep skepticism about allowing machines to process accounts of persecution, arguing that decisions involving human lives should be rooted entirely in fact and empathy rather than algorithmic shortcuts. There are further concerns that the department has bypassed its own transparency guidelines by failing to list these tools in public repositories or notify applicants when AI is used in their files.
The situation has now drawn the attention of the Information Commissioner’s Office, as regulators look into whether withholding details about staff training and tool usage breaches data rights laws. As the government attempts to balance efficiency with legality, legal experts warn that preventing asylum seekers from challenging inaccurate AI summaries could leave them vulnerable to systemic discrimination. For now, the Home Office insists that its quality assurance processes remain robust, even as it faces growing pressure to prove that speed is not coming at the cost of justice.
