Post

1/ For 10 weeks, our fact checkers and data scientists asked five leading AI chatbots the same 22 questions every day: Gemini 3.1, ChatGPT, Grok, DeepSeek and Claude. None repeated the core misinformation they were tested on. But we found several points of failure 🧵

2/ Firstly, rules not yet in force were reported as law. Chatbots said bank cards could be used as voter ID, and that a £10,000 asylum rule was in force, despite it not having been adopted.

4/ We also saw UK-wide answers that ignored differences between the nations. Voter ID rules vary across the UK, but models often left out the caveat needed to make their answers accurate.

5/ And finally, the same question got different answers on different days. One model correctly said England last won a major football trophy in 2025, but said 2022 on other days.

6/ We’re calling on AI companies to make sure models: ▪️check live, authoritative sources for time-sensitive facts ▪️distinguish clearly between rules in force and proposals ▪️keep essential caveats, even if answers get longer ▪️can account for the sources they cite