I put ChatGPT, Claude, Gemini, Perplexity, Grok and Copilot through the same checkable questions and grade every answer against the source. Subscribe and the Bluff Filter is yours, free: a paste-in prompt that makes any AI flag its guesses before you act.
One email a fortnight. Leave whenever you like.
How are the AIs holding up?
Deliberately hard questions, the kind known to trip AI up.
The graded record: Claude held 9 of 9, ChatGPT held 9 of 9, Gemini held 8 of 9, Grok held 8 of 9, Copilot held 8 of 9, Perplexity held 6 of 9.
The full board, every receipt
Documented failures by assistant: Perplexity 11, Gemini 9, ChatGPT 8, Claude 4, Grok 3, Copilot 2.
A running tally of the times we’ve caught each assistant out. For interest, not a grade: we haven’t asked them the same number of questions, so the counts don’t rank them.
Ranked cleanest-first, every answer graded against the source. Tap any card for its full record.
Four short reads, and you’ll have a check you can run on any AI answer.
The kind you’d want on a contract, a letter from a doctor, or an email you’re not sure about.
Start with part 1 →I put four AI assistants through 120 graded everyday sums. Every final answer was right. The mistakes were sitting above the working.
AI TestsWhich is better, Gemini or ChatGPT? I tested both. They're level on getting facts right, but one kept pointing me to sources that didn't back its answer.
GuardrailsThe dangerous AI citation isn't the dead link. It's the working link to a real page that doesn't back the claim. Here's the ten-second check that catches it.
// The Method Four prompts that stop AI inventing the answer.
Read →The Bluff Filter
A paste-in prompt that makes any AI flag what it’s guessing before you act on it. Learn it once, use it on every answer.
Your email stays private, leave whenever you like.
Or follow via RSS: /rss.xml (main) · /lessons (AI failures) · /catches (AI catches).
