AI Tests · 28 Aug 2026 · 9 min
ChatGPT health advice: I tried to make an AI repeat a poisoning
ChatGPT's answer on swapping salt for bromide opened with “Yes”, and the correction only began at word 18.
Which AI is most accurate? · Run 1
Six AI apps, same questions, every answer marked against the official source.
Run 1 · Sat 3 Oct 2026 · mixed plans
Claude and Copilot got all 30 right, but gaps of three or fewer are too small to tell apart, so Claude, Copilot, Gemini and Perplexity are level. Dashes came back empty, not wrong: 18 for Grok. Each was sent again, and 40 of the 42 failed attempts ended on Grok’s own error after about ten minutes.
Free letter
Which AI told the truth this month, with the receipts, plus an AI story worth retelling in between.
Free. Leave whenever you like.
Guess first · question 5 · open question
Guess first, then see what the six apps said.
Saturn, with 293 confirmed moons (JPL and NASA, Aug 2026)
NASA’s own page summary still said 274. An app had to read past it. 16 of 18 tries got it right in run 1.
The run grid · every try, 180 of them
| Question | Claude | Copilot | Gemini | Perplexity | ChatGPT | Grok | Right |
|---|---|---|---|---|---|---|---|
| 1Holidays | 17/18 | ||||||
| 2E-scooter | 17/18easiest | ||||||
| 3Eviction | 15/18 | ||||||
| 4Paternity | 14/18 | ||||||
| 5Moons | 16/18 | ||||||
| 6ETIAS | 16/18 | ||||||
| 7Footwear | 11/18 | ||||||
| 8Clocks | 10/18hardest | ||||||
| 9Towing | 16/18 | ||||||
| 10Shakespeare | 12/18 | ||||||
| Of 30 | 30 | 30 | 27 | 27 | 22 | 8 | 144/180 |
Hardest: question 8, 10 of 18 tries right. Easiest: question 2, 17 of 18. Seven of the ten questions are sealed: they show by a short name, and their wording stays private until they retire. Every question’s one-line description and every answer are on the answers page.
Question 7 · sealed · A Highway Code question about footwear
Wrong · went along with a false premise
97 Source: gov.uk
The whole answer, verbatim: ChatGPT, try 1. The same mark on all three of its tries at this question. ChatGPT: 22 of 30 right in run 1.
Right
There isn't a UK Highway Code rule that specifically bans flip-flops. The rule usually cited is Rule 97, which says that footwear must not prevent you from using the controls in the correct manner. Source: gazetteandherald +1 Rule number: 97. Source: gazetteandherald +1
The whole answer, verbatim: Copilot, try 2. The same mark on all three of its tries at this question. Copilot: 30 of 30 right in run 1.
Every answer is on the answers page, word for word.
Run on run
Run 1 ran on mixed plans, so it counts as a pilot and sits outside the baseline. Most runs should read “No change detected”. Boring is the goal. Smallest move we can tell from chance: about four to seven answers out of 30 for one app (How we test).
Runs 2 and 3, every app on its free plan, are the baseline: together they show how much each app's score moves on its own. From run 4, each report sets the run beside the ones before it, back to run 2, question by question, and can call a change. Run 1 is never set against a later run.