Skip to content
// AI reliability, tested

One real question: can you trust what the AI just told you?

Subscribe and the Bluff Filter is yours, free: a paste-in prompt that makes any AI flag its guesses before you act.

Every fortnight after that, a real case where trusting AI cost someone something.

// The scoreboard9 checkable questions · 12–18 Jul 2026

How are the AIs holding up?

Deliberately hard questions, the kind known to trip AI up.

The graded record: Claude held 9 of 9, ChatGPT held 9 of 9, Gemini held 8 of 9, Grok held 8 of 9, Copilot held 8 of 9, Perplexity held 6 of 9.

The full board, every receipt
Ben Dixon
// The author
Ben Dixon

I test how far you can trust the main AI assistants, and I publish exactly where they get things wrong. Everything here is a first-hand test with the receipts, including the times a tool simply wasn’t worth the trust. More about me →

// The evidence, at a glance

every card a real graded result · tap any card for the receipt

“Vanguard has updated the stated OCF in recent factsheets to 0.22%, which is the most reliable source.”

C ChatGPT · 5 July 2026 · invented: the factsheets said 0.19%

DIXON.AI · THE SCOREBOARD

AAPL live option quote

NVDA close + 30-day vol

MSFT FY24 revenue

CHECKED OUT6 OF 9

AI TESTS

Best AI assistant: only one got everything right

the July board · 12 July 2026

162 graded runs
REPORT

The State of AI Reliability

162 graded runs, watched over

Probably not… three weeks, which is after the normal 30-day right

WRONG WAY ROUND
AI TESTS

An AI told me three weeks was more than thirty days

graded 26 June 2026

DEPARTURES · PERPLEXITY

S01 AAPL live option quote CANCELLED
S02 NVDA close + 30-day vol CANCELLED
S03 MSFT FY24 revenue ON TIME
S04 NVDA data-centre revenue ON TIME
AI TESTS

3 of Perplexity's 9 answers didn't run

the July board

C TEST PASSPORT

MADE NOTHING UP 24 JUL 26 FOLLOWED ME 24 JUL 26 OUT OF DATE 24 JUL 26 OUT OF DATE 24 JUL 26 SOURCE CHECKED OUT 26 JUL 26 WRONG SOURCE 26 JUL 26
SCOREBOARD

Claude, on the record

29 receipted entries

9/9
8/9
6/9
SCOREBOARD

The July podium

poses assigned by score, not by hand

SPECIMEN No. 101

SOURCE CHECKED OUT

C Claude · 26 JUL 26

EVIDENCE

Caught doing it right

the register logs the catches too

WANTED

Made it up

DOCUMENTED 16 TIMES

EVIDENCE

The register's biggest failure family

the evidence register

“Asset Record Saved: NVIDIA Corporation (NVDA) has been logged… (Standard retail discount codes do not apply to equity markets).”

G Gemini · 12 June 2026 · there is no asset record; nothing was logged

Newest: Perplexity vs Claude: which is more reliable? · 7 August 2026