About
I keep score on AI.
I'm Ben Dixon, and each month I ask six AI apps the same ten questions, then check every answer against the official source.
Shakespeare's date of birth is one of my ten questions. Nobody knows it. ChatGPT does, apparently.
23 April 1564.
Too sure Its answer, word for word, on all three tries.
On record Nobody wrote his birthday down. The parish register in Stratford records his baptism, on 26 April 1564. The 23rd is just the day we celebrate it.
Claude, Copilot, Gemini and Perplexity got it right, 12 tries out of 12.
- 6 AI apps
- 10 questions
- 3 tries at each
- 180 tries a run, all on record
AI changes its answers. I keep the tape.
Why I bother
The habit came first. Before I trust something, I like to check where it came from, and I've been caught out enough times to know why.
My first AI tests got several compliments on LinkedIn, and people wanted to know one thing: are these apps getting better, or letting us down? One test is a snapshot. The same test every month shows the direction.
How it's checked
I run it with a lot of help from AI, mostly Claude. Every answer is marked against a key written before any app is asked.
Claude is one of the six, so a model from another lab marks its answers again. That second marker has to catch mistakes we planted before its marks count. The whole method is on How we test.
Tell me what I got wrong
A correction, a counter‑example or a question you'd like tested. I read every message.
Or say hello on LinkedIn.
Confidently Wrong, every fortnight.
One AI story worth retelling, the proof behind it, and a check you can pinch.
Free. Leave whenever you like.