About
I keep score on AI.
I'm Ben Dixon, and each month I ask six AI apps the same ten questions, then check every answer against the official source.
Shakespeare's date of birth is one of my ten questions. Nobody knows it. ChatGPT does, apparently.
23 April 1564.
Too sure Its answer, word for word, on all three tries.
On record Nobody wrote his birthday down. The parish register in Stratford records his baptism, on 26 April 1564. The 23rd is just the day we celebrate it.
Right on all 12 of their tries: Claude, Copilot, Gemini and Perplexity.
180tries a run, all on record
AI changes its answers. I keep the tape.
Why I bother
The habit came first. Before I trust something, I like to check where it came from, and I've been caught out enough times to know why.
My first AI tests got several compliments on LinkedIn, and people wanted to know one thing: are these apps getting better, or letting us down? One test is a snapshot. The same test every month shows the direction.
How it's checked
Every answer is marked against the official source, with the key written before any app is asked. See how I test
Corrections
Tell me what I got wrong
Send me a correction, a counter-example or a question you would like tested. I read every message.
I also take on AI work for businesses. Write to me about that too.
Or say hello on LinkedIn.
Free letter
Confidently Wrong, every fortnight.
Which AI told the truth this month, with the receipts, plus an AI story worth retelling in between.
Free. Leave whenever you like.