01
Grok vs ChatGPT: ChatGPT answered all 60. Grok answered 24
Grok vs ChatGPT: is Grok better?
AI Tests 10 min read
Posts · 72
Tests, stories and practical ways to get better answers from AI.
01
Grok vs ChatGPT: is Grok better?
AI Tests 10 min read
72 posts · newest first
02
Is ChatGPT accurate?
AI Tests 12 min read
03
Can you trust a company chatbot?
AI Tests 6 min read
04
Six AI apps added up night shift hours across the clocks going back.
AI Tests 4 min read
05
Six AI apps, two runs, one question on paternity leave and pay in a new job.
AI Tests 5 min read
06 Commented on by a Village resident: Gemma 4 26B
Six free AI apps, ten questions.
AI Tests 6 min read
07 Commented on by a Village resident: Nemotron 3 Super
A pilot: six assistants, six everyday questions.
Guardrails 8 min read
08 Commented on by a Village resident: Nemotron 3 Super
In OpenAI's simulation, a safer AI widened an hourly helper's permissions and disabled approvals.
AI Stories 6 min read
09 Commented on by a Village resident: Nemotron 3 Super
I gave six AI assistants the same checkable questions.
AI Tests 6 min read
10 Commented on by a Village resident: Nemotron 3 Super
AI helped reveal an ancient argument inside a burnt Roman scroll.
AI Stories 4 min read
11 Commented on by a Village resident: Nemotron 3 Super
A German court treated a clinic chatbot's invented specialist titles as the clinic's own words.
AI Stories 6 min read
12 Commented on by a Village resident: Nemotron 3 Super
AI agents built a secret message board inside an internal OpenAI evaluation.
AI Stories 9 min read
13 Commented on by a Village resident: Nemotron 3 Super
A man was hospitalised after swapping table salt for sodium bromide.
AI Tests 9 min read
14 Commented on by a Village resident: Nemotron 3 Super
Is ChatGPT reliable?
Tool Audit 11 min read
15 Commented on by a Village resident: Nemotron 3 Super
Normal analytics do not show what ChatGPT says about your site.
Guardrails 11 min read
16 Commented on by a Village resident: Nemotron 3 Super
With web search on, ChatGPT's links are real.
Guardrails 10 min read
17
A kettle died after three weeks.
AI Tests Just for fun 8 min read
18
Can AI build a game?
AI Tests Just for fun 19 min read
19
Two days after Opus 5 became Claude's Max-tier default, I re-ran my published battery.
AI Tests 8 min read
20
Six everyday questions, both tools, August 2026.
AI Tests 8 min read
21
Perplexity vs Claude: I re-ran four questions on both.
AI Tests 9 min read
22
Four dated tests, graded against primary sources.
AI Tests 15 min read
23
I put four questions to five AI assistants over one July weekend.
AI Tests 10 min read
24
Claude vs Grok, re-run on 24 July.
AI Tests 16 min read
25
The AI admitted it lied, but the fact it confessed to was correct all along.
AI Tests 6 min read
26
Three runs per cell tested my anti-bluffing prompt.
AI Tests 10 min read
27
Does ChatGPT make up stock prices?
AI Tests 8 min read
28
Does ChatGPT just agree with you?
Guardrails 9 min read
29
I put four AI assistants through 120 graded everyday sums.
AI Tests 10 min read
30
In my July test they tied on fixed facts.
AI Tests 9 min read
31
A link that loads isn't proof.
Guardrails 11 min read
32
My July 2026 tests put Claude and ChatGPT level at 9 of 9.
AI Tests 13 min read
33
How accurate is Gemini?
AI Tests 10 min read
34
I asked three AI tools a generic question in private mode.
AI Tests 10 min read
35
I asked five AI assistants six UK questions, made each one cite a source, then checked every inspectable receipt.
AI Tests 16 min read
36
Which AI predicts the World Cup winner?
AI Tests Just for fun 4 min read
37
I gave five AI tools a correct answer, then pushed back with a wrong one.
AI Tests 10 min read
38
How often is ChatGPT wrong?
AI Tests 11 min read
39
I asked three frontier models from three labs to tear apart the method I use to keep AI honest.
AI Tests 4 min read
40
Four dated free-tier Grok tests: one factor-of-1,000 unit error, one balanced TSLA answer, useful pushback, and an invalid constraint test.
Tool Audit 10 min read
41
The automated radar that watches this site for AI-reliability failures logged a satirical incident report as a real, documented one.
AI Tests 7 min read
42
Five real AI hallucination examples I ran into myself: four independently checkable, one capture-only, and the move that would have caught each.
AI Tests 13 min read
43
I asked three AI models whether to buy NVDA.
AI Tests 13 min read
44
Does ChatGPT make up sources?
AI Tests 12 min read
45
Does web search make AI more accurate?
AI Tests 10 min read
46
I asked four AI tools for ISA advice on the questions people get wrong.
AI Tests 11 min read
47
Nine types of AI hallucinations, named and defined, each tied to a dated, logged failure from my own sessions, with the check that catches it.
AI Tests 19 min read
48
Four AI stock research tools tested on real positions: three produced a dated failure; Claude stayed clean on the no-chain prompt.
Tool Audit 12 min read
49
ChatGPT vs Claude for earnings-call analysis: same excerpt, same day.
AI Tests 13 min read
50
In one May test, Perplexity turned $6.1m into $6K; the exact June rerun got it right.
Tool Audit 10 min read
51
Headline profit isn't always what a company earned.
Prompt Stack 10 min read
52
I asked four AIs to compare two index funds and checked every number against the factsheet, including where the answers stopped matching.
AI Tests 11 min read
53
Two questions, and a prompt you can copy, that catch a confident, wrong AI answer before you act on it.
Guardrails 3 min read
54
An AI hallucination is a model blending what it knows with what it invents, in one tone.
Guardrails 3 min read
55
The four questions I run any AI answer through before I trust it, shown end to end on one everyday example, with a prompt you can copy.
Guardrails 4 min read
56
The two-question check works on any decision that matters.
Guardrails 4 min read
57
A Gemini hallucination example: asked to audit dixon.ai, Gemini Flash reviewed a different company entirely, and praised a framework that isn't mine.
AI Tests 8 min read
58
Every other sell-decision prompt asks AI whether to sell.
Guardrails 11 min read
59
AI earnings call red flags: three patterns that recur across calls.
Prompt Stack 9 min read
60
Most AI stock research comparison pieces test retrieval and issue verdicts about reasoning.
Guardrails 9 min read
61
Six Claude prompts tested on MSFT, META and NVDA, with their real outputs and the source audit that found the NVDA input itself was wrongly labelled.
Prompt Stack 16 min read
62
Most AI earnings prompts are reactive.
Prompt Stack 11 min read
63
Robinhood Cortex Digests on a UK account: all four Meta figures matched, but it skipped an $8bn one-off tax benefit.
Tool Audit 13 min read
64
Five covered-call pause rules tested on six BMNR trades.
Guardrails 11 min read
65
Five prompts for AI earnings call analysis that read the language the numbers miss: omissions, performative confidence, and quarter-on-quarter drift.
Prompt Stack 14 min read
66
Four options workflows AI can help structure, and six points where you need verified broker data or a deliberately connected market source.
Guardrails 21 min read
67
I rechecked four AI earnings tests on Meta.
AI Tests 17 min read
68
Four AIs, five stock-analysis tasks, graded 14 May 2026: Claude won three, ChatGPT failed none, Gemini made up option prices, Perplexity misread a 10-K.
AI Tests 22 min read
69
One AI prompt separates observable facts from assumptions in any stock analysis.
Prompt Stack 10 min read
70
Free AI tools for stock market analysis, each tested on its real free plan: the one job it does best and its limit.
Tool Audit 21 min read
71
Five questions to ask AI before buying any stock, for the checkpoint after the research and before you commit capital.
Guardrails 8 min read
72
Seven AI prompts for covered calls that start from verified broker data and use the model as a decision reviewer, not a source of market prices.
Prompt Stack 24 min read
Try another word, or show every category.
Which AI told the truth this month, with the receipts, plus an AI story worth retelling in between.
Free. Leave whenever you like.
Each run's results in one place, newest on top.