Humanity's Last Exam (with tools)

Expert-level academic knowledge and reasoning test (with tools).

Category
Reasoning
Unit
Percent (%)
Higher is better
Comparison groups
4total
Currently available model rankings · Ranked results: 17
All models (records): Groups: 6 · Entries: 28

Rankings

Values with different source types (official, third-party, paper) or measurement conditions cannot be compared, so rankings are separated by comparison group (the same source, or sources verified to use the same conditions).

Rankings include only models currently available in Claude Code / Codex, excluding legacy models.

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Fable 5.2Max74.2%$4.51Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · Max: 74.2% $4.51"
2Claude Fable 5.2Xhigh73.4%$1.48Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · Xhigh: 73.4% $1.48"
3Claude Fable 5.2High71.5%$0.63Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · High: 71.5% $0.63"
4Claude Fable 5.2Med68.6%$0.21Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · Med: 68.6% $0.21"
5Claude Fable 5.2Low68.4%$0.19Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · Low: 68.4% $0.19"
6Claude Opus 5.5Max67.7%$2.18Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · Max: 67.7% $2.18"
7Claude Opus 5.5Xhigh66.4%$0.69Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · Xhigh: 66.4% $0.69"
8Claude Opus 5.5High63.9%$0.29Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · High: 63.9% $0.29"
9Claude Opus 5.5Med63.0%$0.17Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · Med: 63.0% $0.17"
10Claude Opus 5.5Low57.4%$0.08Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · Low: 57.4% $0.08"
11GPT-6 Astranot stated57.2%—not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted. Values for other vendor models (as listed by Anthropic).
Source excerpt57.2%Location Table, Humanity's Last Exam (with tools) row: 57.2

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Opus 5.5Max67.7%—AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled.
Source excerpt67.7%Location Table, Humanity's Last Exam (with tools) row: 67.7
2GPT-6 Astranot stated57.2%—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled. Values for other vendor models (as listed by Anthropic; null where effort was not stated).
Source excerpt57.2%Location Table, Humanity's Last Exam (with tools) row: 57.2

official results (Introducing Claude Sonnet 5.5)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Opus 5.5not stated67.7%—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: For details on how we run our evaluations, see the Sonnet 5.5 System Card (only efforts explicitly stated in the table)
Source excerpt67.7%Location Table, Humanity's Last Exam (with tools) row: 67.7
2Claude Sonnet 5.5not stated64.5%—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: For details on how we run our evaluations, see the Sonnet 5.5 System Card (only efforts explicitly stated in the table)
Source excerpt64.5%Location Table, Humanity's Last Exam (with tools) row: 64.5

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Sonnet 5.5not stated64.5%—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: see the Haiku 5.5 System Card (effort not stated); Sonnet 5.5 is in the "For reference" column
Source excerpt64.5%Location Table, Humanity's Last Exam (with tools) row: 64.5
2Claude Haiku 5.5not stated57.4%—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: see the Haiku 5.5 System Card (effort not stated)
Source excerpt57.4%Location Table, Humanity's Last Exam (with tools) row: 57.4

All model rankings (records)

These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.

Show rankings including legacy and unavailable models (entries: 28)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Fable 5.2Max74.2%$4.51Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · Max: 74.2% $4.51"
2Claude Fable 5.2Xhigh73.4%$1.48Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · Xhigh: 73.4% $1.48"
3Claude Fable 5.2High71.5%$0.63Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · High: 71.5% $0.63"
4Claude Fable 5.2Med68.6%$0.21Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · Med: 68.6% $0.21"
5Claude Fable 5.2Low68.4%$0.19Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.2 · Low: 68.4% $0.19"
6Claude Opus 5.5Max67.7%$2.18Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · Max: 67.7% $2.18"
7Claude Opus 5.5Xhigh66.4%$0.69Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · Xhigh: 66.4% $0.69"
8Claude Fable 5.1Max65.6%$3.77Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.1 · Max: 65.6% $3.77"
9Claude Fable 5.1Xhigh65.2%$2.70Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.1 · Xhigh: 65.2% $2.70"
10Claude Opus 5.5High63.9%$0.29Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · High: 63.9% $0.29"
11Claude Fable 5.1High63.1%$1.37Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.1 · High: 63.1% $1.37"
12Claude Opus 5.5Med63.0%$0.17Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · Med: 63.0% $0.17"
13Claude Fable 5.1Med62.4%$0.85Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.1 · Med: 62.4% $0.85"
14Claude Fable 5.1Low60.2%$0.59Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Fable 5.1 · Low: 60.2% $0.59"
15Claude Opus 5.5Low57.4%$0.08Cost per attemptAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. A point in the figure "Humanity’s Last Exam (with tools) / Accuracy vs. cost" on the Anthropic announcement page. values were taken from each point's aria-label (DOM); the page shows them only in the figure; value for its own model (announced by Anthropic)
Source excerptHumanity’s Last Exam (with tools) — Accuracy vs. cost: "Opus 5.5 · Low: 57.4% $0.08"
16GPT-6 Astranot stated57.2%—not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted. Values for other vendor models (as listed by Anthropic).
Source excerpt57.2%Location Table, Humanity's Last Exam (with tools) row: 57.2

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Opus 5.5Max67.7%—AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled.
Source excerpt67.7%Location Table, Humanity's Last Exam (with tools) row: 67.7
2Claude Fable 5.1not stated65.6%—AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled.
Source excerpt65.6%Location Table, Humanity's Last Exam (with tools) row: 65.6
3Claude Opus 5not stated63.6%—AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled.
Source excerpt63.6%Location Table, Humanity's Last Exam (with tools) row: 63.6
4GPT-6 Astranot stated57.2%—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled. Values for other vendor models (as listed by Anthropic; null where effort was not stated).
Source excerpt57.2%Location Table, Humanity's Last Exam (with tools) row: 57.2

official results (Introducing Claude Sonnet 5.5)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Opus 5.5not stated67.7%—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: For details on how we run our evaluations, see the Sonnet 5.5 System Card (only efforts explicitly stated in the table)
Source excerpt67.7%Location Table, Humanity's Last Exam (with tools) row: 67.7
2Claude Sonnet 5.5not stated64.5%—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: For details on how we run our evaluations, see the Sonnet 5.5 System Card (only efforts explicitly stated in the table)
Source excerpt64.5%Location Table, Humanity's Last Exam (with tools) row: 64.5
3Claude Sonnet 5not stated54.9%—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: For details on how we run our evaluations, see the Sonnet 5.5 System Card (only efforts explicitly stated in the table)
Source excerpt54.9%Location Table, Humanity's Last Exam (with tools) row: 54.9

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Sonnet 5.5not stated64.5%—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: see the Haiku 5.5 System Card (effort not stated); Sonnet 5.5 is in the "For reference" column
Source excerpt64.5%Location Table, Humanity's Last Exam (with tools) row: 64.5
2Claude Haiku 5.5not stated57.4%—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: see the Haiku 5.5 System Card (effort not stated)
Source excerpt57.4%Location Table, Humanity's Last Exam (with tools) row: 57.4
3Claude Haiku 4.5not stated18.7%—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: see the Haiku 5.5 System Card (effort not stated)
Source excerpt18.7%Location Table, Humanity's Last Exam (with tools) row: 18.7

official results (GLM-5.3 (Hugging Face model card, zai-org))

RankModeleffortScoreSource cost (metric)measured/reported bysource
1GLM-5.3not stated62.5%—Z.aiGLM-5.3 (Hugging Face model card, zai-org)Retrieved 2026-11-13 · Vendor-reported value (self-reported by Z.ai). Card Note: the default for reasoning_effort is max; use the default max to reproduce the benchmarks. Context management up to 300,000 tokens; grading by GPT-5.6-luna (medium). Effort not stated in this footnote.
Source excerptHLE w/ Tools | 62.5Location HF model card "Benchmark" table, HLE w/ Tools row, GLM-5.3 column (leftmost numeric column). Basis: Footnotes, HLE w/ tools

official results (Introducing Claude Opus 4.6)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Opus 4.6Max53.0%—AnthropicIntroducing Claude Opus 4.6Retrieved 2026-11-13 · Vendor-reported value (announced by Anthropic). Text values in the main text and the footnote (the table and figure were not used because they are images). Tools: web search, web fetch, code execution, programmatic tool calling; context compression at 50k (maximum 3M); max reasoning effort; adaptive thinking. Updated from 53.1% following improved cheating detection.
Source excerpt[Feb 23, 2026] Updated reported score for Opus 4.6 for HLE with tools (53.1% to 53.0%).Location Update note at the end of Footnotes on the Opus 4.6 announcement page. The effort is in the Humanity’s Last Exam entry in the same Footnotes (max reasoning effort)