Can the AI read Microsoft’s annual report correctly?
The exact prompt “What was Microsoft’s total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?”
- Asked 25 June 2026
- N=3, memory off
- 6 models
- Copilot joined 18 Jul 2026
- graded vs the primary source
All 6 answered correctly, a clean pass on this one.
- Claude Correct Max · paid 3/3 exact $245.1B / $109.4B.
- Gemini Correct Pro · paid 3/3 = $245.1B / $109.4B.
- Perplexity Correct Pro · paid 3/3 exact $245.122B / $109.433B.
- Grok Correct Free · Grok 4.3 Fast 3/3 exact $245.122B / $109.433B.
- ChatGPT Correct Free 3/3 exact $245.122B / $109.433B (run 3 captured 2026-06-26 on the resume, after the browser-lock fix).
- Copilot Correct Free · Smart 3/3 clean against the 10-K ($245.122B revenue / $109.433B operating income); one run quoted the exact filing figures. The graded numbers carried live microsoft.com links throughout.
Each row is the verdict from N=3 runs, graded case-by-case against the primary source. A confidently wrong answer is the worst outcome: a wrong answer served as reliable, with no hedge, whether invented outright or a real figure served in the wrong field. Appropriate refusal, when no answer is possible, is not a miss.
Filing figures are the easy case: published, fixed, checkable to the penny. If an assistant cannot get a number straight out of a 10-K right, you cannot trust it on anything softer.
MSFT FY2024 10-K (SEC EDGAR), verify the exact revenue + operating income line items at grading time.
Primary source: Microsoft FY2024 10-K, filed with the SEC (EDGAR).
The saved answer behind each grade above, exactly as it came back. Open any one.
ClClaude answered, correct25 Jun 2026
- Run 1
- temporary/incognito chat, memory off
- The founding battery
What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?
Microsoft's fiscal year 2024 (ended June 30, 2024) financial results were strong. Let me give you the key figures.
For the full fiscal year 2024, Microsoft reported total revenue of approximately $245.1 billion, up about 16% from the prior year's $211.9 billion. Operating income came in at roughly $109.4 billion, an increase of about 24% year-over-year.
These figures come from Microsoft's audited annual results. The strong growth was driven largely by the Intelligent Cloud segment (including Azure) and the Productivity and Business Processes segment.
Since you're asking about specific reported figures, let me confirm these are accurate against the official numbers.
The figures are confirmed against Microsoft's official results. For fiscal year 2024 (ended June 30, 2024):
Revenue was $245.1 billion and increased 16% compared to the prior fiscal year. Operating income was $109.4 billion and increased 24% on a GAAP basis (up 22% non-GAAP). Microsoft Microsoft
For additional context, net income was $88.1 billion and increased 22%, and Microsoft Cloud revenue increased 23% to $137.4 billion, which was a major driver of the year's growth. sec sec
One note: a couple of secondary sources mistakenly list these figures in "millions" rather than "billions" — the correct unit is billions of US dollars, as reported in Microsoft's official 8-K and annual report.
Saved 25 Jun 2026 as docs/
GeGemini answered, correct25 Jun 2026
- Run 1
- temporary chat, memory off
- The founding battery
What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?
For the fiscal year 2024 (ended June 30, 2024), Microsoft reported the following financial results:
Total Revenue: $245.1 billion SEC.gov
Operating Income: $109.4 billion agolution
These figures represent a 16% increase in revenue and a 24% increase in operating income compared to the previous fiscal year. agolution
Saved 25 Jun 2026 as docs/
PePerplexity answered, correct25 Jun 2026
- Run 1
- temporary/incognito chat, memory off
- The founding battery
What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?
Microsoft's fiscal year 2024 total revenue was $245.122 billion, and operating income was $109.433 billion. These figures are for the year ended 30 June 2024. [microsoft]
Saved 25 Jun 2026 as docs/
GrGrok answered, correct25 Jun 2026
- Run 1
- private chat, memory off
- The founding battery
What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?
Microsoft's fiscal year 2024 (ended June 30, 2024) results: [Microsoft]
Total revenue: $245.122 billion (up 16% year-over-year). [Microsoft] Operating income: $109.433 billion (up 24% year-over-year). [Microsoft]
These figures come directly from Microsoft's official FY24 earnings releases, annual report, and 10-K/8-K filings. [Microsoft.gcs-web]
For context, this reflects strong growth across segments (especially Intelligent Cloud/Azure and Productivity/Business Processes), with full details available in Microsoft's investor relations materials. Note that FY25 figures (ended June 30, 2025) were higher: ~$281.7B revenue and ~$128.5B operating income.
Saved 25 Jun 2026 as docs/
ChChatGPT answered, correct25 Jun 2026
- Run 1
- temporary chat, memory off
- The founding battery
What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?
For Microsoft's fiscal year 2024 (year ended 30 June 2024):
Total revenue: $245.1 billion
Operating income: $109.4 billion
These figures are reported under GAAP in Microsoft's FY2024 annual results and represent year-over-year growth of about 16% in revenue and 24% in operating income. microsoft.com +1
Saved 25 Jun 2026 as docs/
CoCopilot answered, correct18 Jul 2026
- Run 1
- fresh chat via "New chat" button, memory ON per run spec — recorded as-found, not toggled
- Copilot joins the board
What was Microsoft's total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?
Copilot said
Microsoft's fiscal year 2024 (ended 30 June 2024) results are clearly stated in both the company's Annual Report and its Form 10‑K. The key figures are:
• Total revenue: $245.1 billion • Operating income: $109.4 billion
These values appear consistently across Microsoft's official filings and investor materials. [citation: microsoft.com — "Microsoft 2024 Annual Report"] [citation: Microsoft — "FY24 Q4 - Income Statements - Investor Relations - Microsoft"]
Breakdown and context
Microsoft's FY24 was a record year driven by strong cloud and AI demand:
Revenue grew 16% year‑over‑year, reaching $245.1 billion. [citation: microsoft.com — "Microsoft 2024 Annual Report"]
Operating income increased 24% year‑over‑year, reaching $109.4 billion. [citation: Microsoft — "FY24 Q4 - Income Statements - Investor Relations - Microsoft"]
Intelligent Cloud remained the largest contributor, with Azure and other cloud services up 29–30%. [citation: sec.gov — "EX-99.1"]
If you want, I can also break down FY24 revenue by segment, compare FY24 vs FY23, or chart Microsoft's financial performance over the last decade.
[source chips: www.microsoft.com — Microsoft 2024 Annual Report | Microsoft — FY24 Q4 - Income Statements - Investor Relations - Microsoft | "Show all"]
Saved 18 Jul 2026 as docs/
Writing about this? Copy the verified result with attribution. The per-question grades are machine-readable as first-party JSON at /scoreboard/rdri.json (CC BY 4.0).
AI Reliability Scoreboard: Can the AI read Microsoft’s annual report correctly? Asked (25 June 2026): "What was Microsoft’s total revenue and operating income for fiscal year 2024 (ended 30 June 2024)?" Correct answer: Microsoft FY2024 10-K, filed with the SEC (EDGAR). Result across 6 AI assistants (N=3, memory off; Copilot, joined 18 Jul 2026, memory on as found, disclosed; graded vs the primary source): All 6 answered correctly, a clean pass on this one. Source: https://dixon.ai/scoreboard/q/microsoft-fy2024-revenue-operating-income/, DIXON.AI (CC BY 4.0)
Get the next test in your inbox.
This is one question from the AI Reliability Scoreboard. Confidently Wrong is the fortnightly email: a real case where trusting AI cost someone something, checked against the record, then run again on six assistants to see whether it still happens. The free AI-trust checklist comes with it.
Get the next test →