Skip to content
DIXON.AI The AI Reliability Tracker
Menu

Which AI is most accurate? · Run 1

Claude and Copilot aced run 1

Six AI apps, same questions, every answer marked against the official source.

Run 1 · Sat 3 Oct 2026 · mixed plans

Six apps, head to head

Claudepaid: Max30/30
Copilot30/30
Geminifree27/30
Perplexitypaid: Pro27/30
ChatGPTlogged out22/30
Grokfree8/30
144 right18 wrong18 no answerof 180 tries

Claude and Copilot got all 30 right, but gaps of three or fewer are too small to tell apart, so Claude, Copilot, Gemini and Perplexity are level. Dashes came back empty, not wrong: 18 for Grok. Each was sent again, and 40 of the 42 failed attempts ended on Grok’s own error after about ten minutes.

Free letter

Confidently Wrong, every fortnight

Which AI told the truth this month, with the receipts, plus an AI story worth retelling in between.

Guess first · question 5 · open question

Which planet has the most moons?

Guess first, then see what the six apps said.

Show the answer

Saturn, with 293 confirmed moons (JPL and NASA, Aug 2026)

NASA’s own page summary still said 274. An app had to read past it. 16 of 18 tries got it right in run 1.

Claude
Copilot
Gemini
Perplexity
ChatGPT
Grok

From our earlier tests

Read the stories behind the scores

The run grid · every try, 180 of them

Question 8 (Clocks) was the hardest

RightWrongNo answer
QuestionClaudeCopilotGeminiPerplexityChatGPTGrokRight
1Holidays17/18
2E-scooter17/18easiest
3Eviction15/18
4Paternity14/18
5Moons16/18
6ETIAS16/18
7Footwear11/18
8Clocks10/18hardest
9Towing16/18
10Shakespeare12/18
Of 3030302727228144/180

Hardest: question 8, 10 of 18 tries right. Easiest: question 2, 17 of 18. Seven of the ten questions are sealed: they show by a short name, and their wording stays private until they retire. Every question’s one-line description and every answer are on the answers page.

Question 7 · sealed · A Highway Code question about footwear

Same question, two answers

ChatGPT

Wrong · went along with a false premise

97 Source: gov.uk

The whole answer, verbatim: ChatGPT, try 1. The same mark on all three of its tries at this question. ChatGPT: 22 of 30 right in run 1.

Read it in full

Copilot

Right

There isn't a UK Highway Code rule that specifically bans flip-flops. The rule usually cited is Rule 97, which says that footwear must not prevent you from using the controls in the correct manner. Source: gazetteandherald +1 Rule number: 97. Source: gazetteandherald +1

The whole answer, verbatim: Copilot, try 2. The same mark on all three of its tries at this question. Copilot: 30 of 30 right in run 1.

Read it in full

Every answer is on the answers page, word for word.

Run on run

First run, so no change yet.

Run 1 ran on mixed plans, so it counts as a pilot and sits outside the baseline. Most runs should read “No change detected”. Boring is the goal. Smallest move we can tell from chance: about four to seven answers out of 30 for one app (How we test).

When a change can be called

Runs 2 and 3, every app on its free plan, are the baseline: together they show how much each app's score moves on its own. From run 4, each report sets the run beside the ones before it, back to run 2, question by question, and can call a change. Run 1 is never set against a later run.