New Zealand Police restart AI trial after officers misused unapproved models
By
Phil Pennington
A baker's-dozen of insight crammed into one ring.
Summary
New Zealand Police officers trialling generative AI significantly misused the technology, leading to the project being scrapped. Six months later, the project was restarted after officers were found using unapproved AI models on their own. The high-tech crime group has now been using the approved Whisper AI system for nine months with additional controls. One of the AI systems tested was 45 percent inaccurate on Māori and Pacific languages, yet was still used by officers.
Key quotes
· 3 pulledAddressing hallucinations is an ongoing area of research.
Police officers trialling generative AI significantly misused it and the project was dumped, only to be restarted six months later after officers used unapproved AI models.
One of the AI systems was 45 percent inaccurate on Māori and Pacific languages, but was still used by officers.
You might also wanna read
Police Chief Retires After Force Uses Microsoft Copilot AI Hallucination to Ban Football Fans
West Midlands Police Chief Constable Craig Guildford retired after his force used fictional AI-generated content from Microsoft Copilot to b

State Attorneys General Warn AI Companies Their Chatbots May Violate State Laws
State attorneys general from over 40 US states have issued a bipartisan warning to major AI companies including Meta, Google, and OpenAI, st
Police in England and Wales told to halt AI use in court statements

Essex police suspend live facial recognition after study finds racial bias against Black people
Essex police have paused the use of live facial recognition (LFR) technology after a study revealed the cameras were significantly more like
OpenAI Withholds New Text-Generation Model Over Safety Concerns, Reigniting AI Ethics Debate
OpenAI has developed a new text-generation model capable of writing coherent, versatile prose but has decided not to release the full algori
The Ongoing Problem of AI-Generated False Citations in Court Filings
This article examines the persistent problem of lawyers submitting court filings containing AI-hallucinated case citations, despite increase
