Rankings

Values with different source types or measurement conditions (comparison groups) are ranked separately. Overall rankings aggregate only models with values for the same set of comparison groups, and costs are not combined across benchmarks. See About for the methods.

Ranks, percentiles, and frontiers include only models currently available in Claude Code / Codex (models: 8, excluding legacy models). For rankings including legacy and unavailable models, see All model rankings (records). Ranks differ because the set of models differs.

Overall (performance first)

Only model × effort entries with values for the same set of comparison groups are aggregated. Within each group, included entries are ranked and converted to percentiles (first = 100, last = 0), averaged across groups of the same benchmark, then averaged across benchmarks for ranking. Multiple groups for one benchmark do not give it extra weight. Aggregations cover different groups, so their scores are not comparable.

Aggregations are ordered by descending model count, benchmark count, then entry count. The aggregation containing the most models currently available in Claude Code / Codex opens first. The rest are collapsed under “Other aggregations” by source type.

Aggregation criteria: minimum models: 3 (different efforts count as one model); minimum benchmarks: 3 (multiple comparison groups for the same benchmark count as one). Coverage n/N counts benchmarks; N is the number of benchmarks with values of the same source type. “measured/reported by” for each group shows the parties and counts for values included in that aggregation. Even in official announcements, the publisher may have measured values for other companies’ models.

third-party · Models: 8 · Entries: 8 × Groups: 4 (benchmark coverage 4/10)GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), SimpleQA Verified
  1. GPQA Diamondthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv) CC BY 4.0measured/reported by: Epoch AI (8)
  2. FrontierMath Tiers 1-3(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0measured/reported by: Epoch AI (8)
  3. FrontierMath Tier 4(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0measured/reported by: Epoch AI (8)
  4. SimpleQA Verifiedthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, simpleqa_verified.csv) CC BY 4.0measured/reported by: Epoch AI (8)
RankModeleffortMean percentileBenchmarks with values1. GPQA Diamond2. FrontierMath Tiers 1-3(v2)3. FrontierMath Tier 4(v2)4. SimpleQA Verified
1Claude Fable 5.2Max846/1093.9%95.1%100.0%94.0%
1GPT-6 AstraMax849/1095.8%93.7%97.6%75.6%
3GPT-6.1 SolMax799/1095.4%93.7%100.0%73.9%
4Claude Opus 5.5Max507/1090.6%91.2%95.0%72.2%
5GPT-6.1 TerraMax466/1094.3%90.9%92.7%57.3%
6Claude Sonnet 5.5Max437/1095.6%88.8%80.5%46.5%
7GPT-6 LunaMax149/1090.5%79.0%56.1%41.4%
8Claude Haiku 5.5Max06/1089.7%75.1%46.3%23.8%
Other aggregations (entries: 11)

official

official · Models: 3 · Entries: 3 × Groups: 7 (benchmark coverage 7/27)FrontierSWE 2, AutomationBench, Terminal-Bench-Science 0.1, OSWorld 2.1 (offline set, partial), RoboDojo Sim, AA-Briefcase v1.1(rubric), AA-Briefcase v1.1(Elo)
  1. FrontierSWE 2official · Introducing Claude Fable 5.2 and Claude Mythos 5.2measured/reported by: Anthropic (2) · not stated (1)
  2. AutomationBenchofficial · Introducing Claude Fable 5.2 and Claude Mythos 5.2measured/reported by: Anthropic (2) · not stated (1)
  3. Terminal-Bench-Science 0.1official · Introducing Claude Fable 5.2 and Claude Mythos 5.2measured/reported by: Anthropic (2) · not stated (1)
  4. OSWorld 2.1 (offline set, partial)official · Introducing Claude Fable 5.2 and Claude Mythos 5.2measured/reported by: Anthropic (2) · not stated (1)
  5. RoboDojo Simofficial · Introducing Claude Fable 5.2 and Claude Mythos 5.2measured/reported by: Anthropic (3)
  6. AA-Briefcase v1.1(rubric)official · Introducing Claude Fable 5.2 and Claude Mythos 5.2measured/reported by: Anthropic (2) · not stated (1)
  7. AA-Briefcase v1.1(Elo)official · Introducing Claude Fable 5.2 and Claude Mythos 5.2measured/reported by: Anthropic (2) · not stated (1)
RankModeleffortMean percentileBenchmarks with values1. FrontierSWE 22. AutomationBench3. Terminal-Bench-Science 0.14. OSWorld 2.1 (offline set, partial)5. RoboDojo Sim6. AA-Briefcase v1.1(rubric)7. AA-Briefcase v1.1(Elo)
1Claude Fable 5.2not stated937/2769.9%51.4%74.6%89.3%64.9%66.1%1,785
2Claude Opus 5.5not stated4314/2762.3%42.5%58.7%87.2%39.4%61.2%1,800
3GPT-6 Astranot stated1412/2765.5%41.4%68.1%79.5%29.8%52.0%1,569

third-party

third-party · Models: 7 · Entries: 7 × Groups: 5 (benchmark coverage 5/10)GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), OTIS Mock AIME 2024-2025, SimpleQA Verified
  1. GPQA Diamondthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  2. FrontierMath Tiers 1-3(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  3. FrontierMath Tier 4(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  4. OTIS Mock AIME 2024-2025third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, otis_mock_aime_2024_2025.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  5. SimpleQA Verifiedthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, simpleqa_verified.csv) CC BY 4.0measured/reported by: Epoch AI (7)
RankModeleffortMean percentileBenchmarks with values1. GPQA Diamond2. FrontierMath Tiers 1-3(v2)3. FrontierMath Tier 4(v2)4. OTIS Mock AIME 2024-20255. SimpleQA Verified
1GPT-6 AstraMax789/1095.8%93.7%97.6%100.0%75.6%
2GPT-6.1 SolMax739/1095.4%93.7%100.0%100.0%73.9%
3Claude Fable 5.2Max686/1093.9%95.1%100.0%99.7%94.0%
4Claude Opus 5.5Max477/1090.6%91.2%95.0%100.0%72.2%
5GPT-6.1 TerraMax436/1094.3%90.9%92.7%100.0%57.3%
6Claude Sonnet 5.5Max407/1095.6%88.8%80.5%100.0%46.5%
7GPT-6 LunaMax09/1090.5%79.0%56.1%98.9%41.4%
third-party · Models: 7 · Entries: 7 × Groups: 5 (benchmark coverage 5/10)GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), SimpleQA Verified, Chess Puzzles(Epoch AI)
  1. GPQA Diamondthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  2. FrontierMath Tiers 1-3(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  3. FrontierMath Tier 4(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  4. SimpleQA Verifiedthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, simpleqa_verified.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  5. Chess Puzzles(Epoch AI)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0measured/reported by: Epoch AI (7)
RankModeleffortMean percentileBenchmarks with values1. GPQA Diamond2. FrontierMath Tiers 1-3(v2)3. FrontierMath Tier 4(v2)4. SimpleQA Verified5. Chess Puzzles(Epoch AI)
1Claude Fable 5.2Max886/1093.9%95.1%100.0%94.0%79.0%
2GPT-6 AstraMax829/1095.8%93.7%97.6%75.6%74.0%
3GPT-6.1 SolMax739/1095.4%93.7%100.0%73.9%68.0%
4Claude Opus 5.5Max477/1090.6%91.2%95.0%72.2%67.0%
5Claude Sonnet 5.5Max437/1095.6%88.8%80.5%46.5%59.0%
6GPT-6 LunaMax139/1090.5%79.0%56.1%41.4%36.0%
7Claude Haiku 5.5Max36/1089.7%75.1%46.3%23.8%55.0%
third-party · Models: 7 · Entries: 7 × Groups: 5 (benchmark coverage 5/10)GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), SimpleQA Verified, MirrorCode
  1. GPQA Diamondthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  2. FrontierMath Tiers 1-3(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  3. FrontierMath Tier 4(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  4. SimpleQA Verifiedthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, simpleqa_verified.csv) CC BY 4.0measured/reported by: Epoch AI (7)
  5. MirrorCodethird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0measured/reported by: Epoch AI (7)
RankModeleffortMean percentileBenchmarks with values1. GPQA Diamond2. FrontierMath Tiers 1-3(v2)3. FrontierMath Tier 4(v2)4. SimpleQA Verified5. MirrorCode
1GPT-6 AstraMax789/1095.8%93.7%97.6%75.6%60.0%
2GPT-6.1 SolMax759/1095.4%93.7%100.0%73.9%61.1%
3Claude Opus 5.5Max637/1090.6%91.2%95.0%72.2%95.6%
4Claude Sonnet 5.5Max577/1095.6%88.8%80.5%46.5%97.8%
5GPT-6.1 TerraMax506/1094.3%90.9%92.7%57.3%76.7%
6Claude Haiku 5.5Max136/1089.7%75.1%46.3%23.8%78.9%
6GPT-6 LunaMax139/1090.5%79.0%56.1%41.4%26.7%
third-party · Models: 6 · Entries: 6 × Groups: 6 (benchmark coverage 6/10)GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), OTIS Mock AIME 2024-2025, SimpleQA Verified, Chess Puzzles(Epoch AI)
  1. GPQA Diamondthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  2. FrontierMath Tiers 1-3(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  3. FrontierMath Tier 4(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  4. OTIS Mock AIME 2024-2025third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, otis_mock_aime_2024_2025.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  5. SimpleQA Verifiedthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, simpleqa_verified.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  6. Chess Puzzles(Epoch AI)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0measured/reported by: Epoch AI (6)
RankModeleffortMean percentileBenchmarks with values1. GPQA Diamond2. FrontierMath Tiers 1-3(v2)3. FrontierMath Tier 4(v2)4. OTIS Mock AIME 2024-20255. SimpleQA Verified6. Chess Puzzles(Epoch AI)
1GPT-6 AstraMax779/1095.8%93.7%97.6%100.0%75.6%74.0%
2Claude Fable 5.2Max756/1093.9%95.1%100.0%99.7%94.0%79.0%
3GPT-6.1 SolMax689/1095.4%93.7%100.0%100.0%73.9%68.0%
4Claude Opus 5.5Max427/1090.6%91.2%95.0%100.0%72.2%67.0%
5Claude Sonnet 5.5Max387/1095.6%88.8%80.5%100.0%46.5%59.0%
6GPT-6 LunaMax09/1090.5%79.0%56.1%98.9%41.4%36.0%
third-party · Models: 6 · Entries: 6 × Groups: 6 (benchmark coverage 6/10)GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), OTIS Mock AIME 2024-2025, SimpleQA Verified, MirrorCode
  1. GPQA Diamondthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  2. FrontierMath Tiers 1-3(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  3. FrontierMath Tier 4(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  4. OTIS Mock AIME 2024-2025third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, otis_mock_aime_2024_2025.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  5. SimpleQA Verifiedthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, simpleqa_verified.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  6. MirrorCodethird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0measured/reported by: Epoch AI (6)
RankModeleffortMean percentileBenchmarks with values1. GPQA Diamond2. FrontierMath Tiers 1-3(v2)3. FrontierMath Tier 4(v2)4. OTIS Mock AIME 2024-20255. SimpleQA Verified6. MirrorCode
1GPT-6 AstraMax759/1095.8%93.7%97.6%100.0%75.6%60.0%
2GPT-6.1 SolMax729/1095.4%93.7%100.0%100.0%73.9%61.1%
3Claude Opus 5.5Max577/1090.6%91.2%95.0%100.0%72.2%95.6%
4Claude Sonnet 5.5Max507/1095.6%88.8%80.5%100.0%46.5%97.8%
5GPT-6.1 TerraMax476/1094.3%90.9%92.7%100.0%57.3%76.7%
6GPT-6 LunaMax09/1090.5%79.0%56.1%98.9%41.4%26.7%
third-party · Models: 6 · Entries: 6 × Groups: 6 (benchmark coverage 6/10)GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), SimpleQA Verified, Chess Puzzles(Epoch AI), MirrorCode
  1. GPQA Diamondthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  2. FrontierMath Tiers 1-3(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  3. FrontierMath Tier 4(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  4. SimpleQA Verifiedthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, simpleqa_verified.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  5. Chess Puzzles(Epoch AI)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0measured/reported by: Epoch AI (6)
  6. MirrorCodethird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0measured/reported by: Epoch AI (6)
RankModeleffortMean percentileBenchmarks with values1. GPQA Diamond2. FrontierMath Tiers 1-3(v2)3. FrontierMath Tier 4(v2)4. SimpleQA Verified5. Chess Puzzles(Epoch AI)6. MirrorCode
1GPT-6 AstraMax829/1095.8%93.7%97.6%75.6%74.0%60.0%
2GPT-6.1 SolMax759/1095.4%93.7%100.0%73.9%68.0%61.1%
3Claude Opus 5.5Max607/1090.6%91.2%95.0%72.2%67.0%95.6%
4Claude Sonnet 5.5Max577/1095.6%88.8%80.5%46.5%59.0%97.8%
5Claude Haiku 5.5Max136/1089.7%75.1%46.3%23.8%55.0%78.9%
5GPT-6 LunaMax139/1090.5%79.0%56.1%41.4%36.0%26.7%
third-party · Models: 5 · Entries: 5 × Groups: 7 (benchmark coverage 7/10)GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), OTIS Mock AIME 2024-2025, SimpleQA Verified, Chess Puzzles(Epoch AI), MirrorCode
  1. GPQA Diamondthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv) CC BY 4.0measured/reported by: Epoch AI (5)
  2. FrontierMath Tiers 1-3(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0measured/reported by: Epoch AI (5)
  3. FrontierMath Tier 4(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0measured/reported by: Epoch AI (5)
  4. OTIS Mock AIME 2024-2025third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, otis_mock_aime_2024_2025.csv) CC BY 4.0measured/reported by: Epoch AI (5)
  5. SimpleQA Verifiedthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, simpleqa_verified.csv) CC BY 4.0measured/reported by: Epoch AI (5)
  6. Chess Puzzles(Epoch AI)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0measured/reported by: Epoch AI (5)
  7. MirrorCodethird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0measured/reported by: Epoch AI (5)
RankModeleffortMean percentileBenchmarks with values1. GPQA Diamond2. FrontierMath Tiers 1-3(v2)3. FrontierMath Tier 4(v2)4. OTIS Mock AIME 2024-20255. SimpleQA Verified6. Chess Puzzles(Epoch AI)7. MirrorCode
1GPT-6 AstraMax799/1095.8%93.7%97.6%100.0%75.6%74.0%60.0%
2GPT-6.1 SolMax719/1095.4%93.7%100.0%100.0%73.9%68.0%61.1%
3Claude Opus 5.5Max527/1090.6%91.2%95.0%100.0%72.2%67.0%95.6%
4Claude Sonnet 5.5Max487/1095.6%88.8%80.5%100.0%46.5%59.0%97.8%
5GPT-6 LunaMax09/1090.5%79.0%56.1%98.9%41.4%36.0%26.7%
third-party · Models: 4 · Entries: 4 × Groups: 3 (benchmark coverage 3/10)OTIS Mock AIME 2024-2025, LMArena Text (style control, overall), LMArena Text Coding (without style control)
  1. OTIS Mock AIME 2024-2025third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, otis_mock_aime_2024_2025.csv) CC BY 4.0measured/reported by: Epoch AI (4)
  2. LMArena Text (style control, overall)third-party · lmarena-ai/leaderboard-dataset text_style_control/latest-00000-of-00001.parquet (CC BY 4.0)measured/reported by: LMArena (4)
  3. LMArena Text Coding (without style control)third-party · lmarena-ai/leaderboard-dataset text/latest-00000-of-00001.parquet (CC BY 4.0)measured/reported by: LMArena (4)
RankModeleffortMean percentileBenchmarks with values1. OTIS Mock AIME 2024-20252. LMArena Text (style control, overall)3. LMArena Text Coding (without style control)
1GPT-6.1 SolMax839/10100.0%1,4821,486
1GPT-6 AstraMax839/10100.0%1,4741,494
3GPT-6 LunaMax229/1098.9%1,4411,432
4Claude Haiku 5.5High113/1097.2%1,4221,454
third-party · Models: 4 · Entries: 4 × Groups: 3 (benchmark coverage 3/10)MirrorCode, LMArena Text (style control, overall), LMArena Text Coding (without style control)
  1. MirrorCodethird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0measured/reported by: Epoch AI (4)
  2. LMArena Text (style control, overall)third-party · lmarena-ai/leaderboard-dataset text_style_control/latest-00000-of-00001.parquet (CC BY 4.0)measured/reported by: LMArena (4)
  3. LMArena Text Coding (without style control)third-party · lmarena-ai/leaderboard-dataset text/latest-00000-of-00001.parquet (CC BY 4.0)measured/reported by: LMArena (4)
RankModeleffortMean percentileBenchmarks with values1. MirrorCode2. LMArena Text (style control, overall)3. LMArena Text Coding (without style control)
1Claude Opus 5.5High1003/1078.9%1,5061,542
2GPT-6.1 SolMax569/1061.1%1,4821,486
3GPT-6 AstraMax449/1060.0%1,4741,494
4GPT-6 LunaMax09/1026.7%1,4411,432
third-party · Models: 3 · Entries: 3 × Groups: 9 (benchmark coverage 9/10)GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), OTIS Mock AIME 2024-2025, SimpleQA Verified, Chess Puzzles(Epoch AI), MirrorCode, LMArena Text (style control, overall), LMArena Text Coding (without style control)
  1. GPQA Diamondthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv) CC BY 4.0measured/reported by: Epoch AI (3)
  2. FrontierMath Tiers 1-3(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0measured/reported by: Epoch AI (3)
  3. FrontierMath Tier 4(v2)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0measured/reported by: Epoch AI (3)
  4. OTIS Mock AIME 2024-2025third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, otis_mock_aime_2024_2025.csv) CC BY 4.0measured/reported by: Epoch AI (3)
  5. SimpleQA Verifiedthird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, simpleqa_verified.csv) CC BY 4.0measured/reported by: Epoch AI (3)
  6. Chess Puzzles(Epoch AI)third-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0measured/reported by: Epoch AI (3)
  7. MirrorCodethird-party · Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0measured/reported by: Epoch AI (3)
  8. LMArena Text (style control, overall)third-party · lmarena-ai/leaderboard-dataset text_style_control/latest-00000-of-00001.parquet (CC BY 4.0)measured/reported by: LMArena (3)
  9. LMArena Text Coding (without style control)third-party · lmarena-ai/leaderboard-dataset text/latest-00000-of-00001.parquet (CC BY 4.0)measured/reported by: LMArena (3)
RankModeleffortMean percentileBenchmarks with values1. GPQA Diamond2. FrontierMath Tiers 1-3(v2)3. FrontierMath Tier 4(v2)4. OTIS Mock AIME 2024-20255. SimpleQA Verified6. Chess Puzzles(Epoch AI)7. MirrorCode8. LMArena Text (style control, overall)9. LMArena Text Coding (without style control)
1GPT-6 AstraMax789/1095.8%93.7%97.6%100.0%75.6%74.0%60.0%1,4741,494
2GPT-6.1 SolMax729/1095.4%93.7%100.0%100.0%73.9%68.0%61.1%1,4821,486
3GPT-6 LunaMax09/1090.5%79.0%56.1%98.9%41.4%36.0%26.7%1,4411,432

Cost balance

Source costs have different meanings across benchmarks, so they are considered only within comparison groups and never combined across benchmarks.

  • Frontier: Points for which no better score exists at the same or lower cost (Pareto frontier), ordered by cost. Points without source costs are excluded.
  • Effort changes: Score differences (in points for percentage metrics) and cost ratios between adjacent efforts with values for the same model. Missing intermediate efforts are noted. When measured/reported by differs at the two ends, it is shown as “before → after”.

Terminal-Bench 4.0

official results (Accuracy vs Cost figure announced by Anthropic (Opus 5.5 and Sonnet 5.5 pages))

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Sonnet 5.5Low20.0%$0.76Cost per attemptAnthropic
Claude Sonnet 5.5Med28.8%$0.83Cost per attemptAnthropic
Claude Opus 5.5Low38.5%$1.29Cost per attemptAnthropic
Claude Sonnet 5.5High43.0%$1.94Cost per attemptAnthropic
Claude Opus 5.5Med57.6%$2.94Cost per attemptAnthropic
Claude Opus 5.5High64.2%$3.88Cost per attemptAnthropic
Claude Opus 5.5Xhigh66.4%$7.35Cost per attemptAnthropic
Claude Sonnet 5.5Max70.6%$12.54Cost per attemptAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5Low → Med+19.1pt×2.28Anthropic
Claude Opus 5.5Med → High+6.6pt×1.32Anthropic
Claude Opus 5.5High → Xhigh+2.2pt×1.89Anthropic
Claude Opus 5.5Xhigh → Max-1.6pt×1.53Anthropic
Claude Sonnet 5.5Low → Med+8.8pt×1.09Anthropic
Claude Sonnet 5.5Med → High+14.2pt×2.34Anthropic
Claude Sonnet 5.5High → Xhigh+18.5pt×2.73Anthropic
Claude Sonnet 5.5Xhigh → Max+9.1pt×2.37Anthropic
GPT-6 AstraLow → Med+4.2pt×1.24OpenAI
GPT-6 AstraMed → High+4.0pt×1.17OpenAI
GPT-6 AstraHigh → Xhigh-0.3pt×1.04OpenAI
GPT-6 AstraXhigh → Max-0.9pt×1.38OpenAI

official results (Introducing Claude Haiku 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Haiku 5.5Low12.7%$0.42Cost per attemptAnthropic
Claude Sonnet 5.5Low20.0%$0.62Cost per attemptAnthropic
Claude Sonnet 5.5Med28.8%$0.68Cost per attemptAnthropic
Claude Sonnet 5.5High43.0%$1.46Cost per attemptAnthropic
Claude Sonnet 5.5Xhigh61.5%$4.34Cost per attemptAnthropic
Claude Sonnet 5.5Max70.6%$10.44Cost per attemptAnthropic

Points without source costs are excluded from the frontier (excluded: 1).

Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Sonnet 5.5Low → Med+8.8pt×1.1Anthropic
Claude Sonnet 5.5Med → High+14.2pt×2.15Anthropic
Claude Sonnet 5.5High → Xhigh+18.5pt×2.97Anthropic
Claude Sonnet 5.5Xhigh → Max+9.1pt×2.41Anthropic
Claude Haiku 5.5Low → Med+7.6pt×1.62Anthropic
Claude Haiku 5.5Med → High+4.5pt×1.53Anthropic
Claude Haiku 5.5High → Xhigh+6.7pt×1.68Anthropic
Claude Haiku 5.5Xhigh → Max+7.7pt×1.51Anthropic

FrontierCode v1.1(main set)

official results (Accuracy vs Cost figure announced by Anthropic (Opus 5.5 and Sonnet 5.5 pages))

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Sonnet 5.5Low29.3%$0.19Cost per taskAnthropic
Claude Sonnet 5.5Med36.5%$0.24Cost per taskAnthropic
Claude Opus 5.5Low47.3%$0.40Cost per taskAnthropic
Claude Sonnet 5.5High49.4%$0.42Cost per taskAnthropic
Claude Opus 5.5Med54.6%$0.80Cost per taskAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5Low → Med+7.3pt×2.0Anthropic
Claude Opus 5.5Med → High-0.6pt×1.36Anthropic
Claude Opus 5.5High → Xhigh-2.6pt×2.06Anthropic
Claude Opus 5.5Xhigh → Max+3.0pt×2.75Anthropic
Claude Sonnet 5.5Low → Med+7.2pt×1.26Anthropic
Claude Sonnet 5.5Med → High+12.9pt×1.75Anthropic
Claude Sonnet 5.5High → Xhigh+2.7pt×3.79Anthropic
Claude Sonnet 5.5Xhigh → Max-5.9pt×13.07Anthropic
GPT-6 AstraLow → Med+3.5pt×1.43not stated
GPT-6 AstraMed → High+2.1pt×1.25not stated
GPT-6 AstraHigh → Xhigh-0.3pt×1.09not stated
GPT-6 AstraXhigh → Max+2.7pt×1.41not stated

FrontierCode 2.0

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low14.7%$0.75Cost per taskAnthropic
Claude Opus 5.5Med30.1%$1.70Cost per taskAnthropic
Claude Fable 5.2Low34.2%$2.10Cost per taskAnthropic
Claude Opus 5.5High34.5%$2.42Cost per taskAnthropic
Claude Fable 5.2Med37.6%$2.48Cost per taskAnthropic
GPT-6 AstraHigh38.3%$4.28Cost per tasknot stated
GPT-6 AstraXhigh41.4%$4.54Cost per tasknot stated
Claude Opus 5.5Xhigh43.4%$5.18Cost per taskAnthropic
Claude Fable 5.2High45.3%$6.72Cost per taskAnthropic
Claude Opus 5.5Max45.5%$12.82Cost per taskAnthropic
Claude Fable 5.2Xhigh49.1%$14.19Cost per taskAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Fable 5.2Low → Med+3.4pt×1.18Anthropic
Claude Fable 5.2Med → High+7.7pt×2.71Anthropic
Claude Fable 5.2High → Xhigh+3.8pt×2.11Anthropic
Claude Fable 5.2Xhigh → Max-3.5pt×3.15Anthropic
Claude Opus 5.5Low → Med+15.4pt×2.27Anthropic
Claude Opus 5.5Med → High+4.4pt×1.42Anthropic
Claude Opus 5.5High → Xhigh+8.9pt×2.14Anthropic
Claude Opus 5.5Xhigh → Max+2.1pt×2.47Anthropic
GPT-6 AstraLow → Med+5.7pt×1.43not stated
GPT-6 AstraMed → High+1.5pt×1.23not stated
GPT-6 AstraHigh → Xhigh+3.1pt×1.06not stated
GPT-6 AstraXhigh → Max+1.4pt×1.47not stated

CursorBench 4.0

official results (Introducing Claude Opus 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low43.7%$1.18Cost per taskAnthropic
Claude Opus 5.5Med52.5%$2.90Cost per taskAnthropic
Claude Opus 5.5High56.0%$3.97Cost per taskAnthropic
Claude Opus 5.5Xhigh56.0%$6.99Cost per taskAnthropic
Claude Opus 5.5Max57.8%$13.43Cost per taskAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5Low → Med+8.8pt×2.46Anthropic
Claude Opus 5.5Med → High+3.5pt×1.37Anthropic
Claude Opus 5.5High → Xhigh±0.0pt×1.76Anthropic
Claude Opus 5.5Xhigh → Max+1.8pt×1.92Anthropic

official results (Introducing Claude Sonnet 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Sonnet 5.5Low35.8%$0.50Cost per taskAnthropic
Claude Sonnet 5.5Med39.2%$0.70Cost per taskAnthropic
Claude Opus 5.5Low43.7%$1.17Cost per taskAnthropic
Claude Sonnet 5.5High47.8%$1.67Cost per taskAnthropic
Claude Opus 5.5Med52.5%$2.91Cost per taskAnthropic
Claude Sonnet 5.5Xhigh53.1%$3.88Cost per taskAnthropic
Claude Opus 5.5High56.0%$3.97Cost per taskAnthropic
Claude Opus 5.5Xhigh56.0%$6.98Cost per taskAnthropic
Claude Opus 5.5Max57.8%$13.43Cost per taskAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5Low → Med+8.8pt×2.49Anthropic
Claude Opus 5.5Med → High+3.5pt×1.36Anthropic
Claude Opus 5.5High → Xhigh±0.0pt×1.76Anthropic
Claude Opus 5.5Xhigh → Max+1.8pt×1.92Anthropic
Claude Sonnet 5.5Low → Med+3.4pt×1.4Anthropic
Claude Sonnet 5.5Med → High+8.6pt×2.39Anthropic
Claude Sonnet 5.5High → Xhigh+5.3pt×2.32Anthropic
Claude Sonnet 5.5Xhigh → Max+2.4pt×2.49Anthropic

official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)

No frontier can be shown because no points have source costs.

Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Fable 5.2Low → Med+1.6pt—Cursor
Claude Fable 5.2Med → High+2.1pt—Cursor
Claude Fable 5.2High → Xhigh-0.6pt—Cursor
Claude Fable 5.2Xhigh → Max+3.7pt—Cursor

GDPval-AA v2.1

official results (Introducing Claude Opus 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low1,224$0.21Estimated cost per taskAnthropic
GPT-6 AstraLow1,366$0.85Estimated cost per tasknot stated
Claude Opus 5.5Med1,576$0.86Estimated cost per taskAnthropic
Claude Opus 5.5High1,692$1.54Estimated cost per taskAnthropic
Claude Opus 5.5Xhigh1,820$4.21Estimated cost per taskAnthropic
Claude Opus 5.5Max1,846$8.92Estimated cost per taskAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5Low → Med+352×4.1Anthropic
Claude Opus 5.5Med → High+116×1.79Anthropic
Claude Opus 5.5High → Xhigh+128×2.73Anthropic
Claude Opus 5.5Xhigh → Max+26×2.12Anthropic
GPT-6 AstraLow → Med+102×2.14not stated
GPT-6 AstraMed → High+17×1.34not stated
GPT-6 AstraHigh → Xhigh+31×1.25not stated
GPT-6 AstraXhigh → Max+26×1.49not stated

official results (Introducing Claude Haiku 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
GPT-6 LunaLow1,036$0.004Cost per tasknot stated
Claude Haiku 5.5Low1,125$0.01Cost per taskAnthropic
GPT-6 LunaMed1,262$0.02Cost per tasknot stated
GPT-6 LunaHigh1,344$0.03Cost per tasknot stated
GPT-6 LunaXhigh1,364$0.05Cost per tasknot stated
GPT-6 LunaMax1,437$0.09Cost per tasknot stated
Claude Haiku 5.5Xhigh1,513$0.27Cost per taskAnthropic
Claude Sonnet 5.5High1,551$0.62Cost per taskAnthropic
Claude Haiku 5.5Max1,620$0.87Cost per taskAnthropic
Claude Sonnet 5.5Xhigh1,731$1.88Cost per taskAnthropic
Claude Sonnet 5.5Max1,840$6.78Cost per taskAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Sonnet 5.5Low → Med+145×1.23Anthropic
Claude Sonnet 5.5Med → High+227×2.3Anthropic
Claude Sonnet 5.5High → Xhigh+180×3.03Anthropic
Claude Sonnet 5.5Xhigh → Max+109×3.61Anthropic
Claude Haiku 5.5Low → Med+152×3.0Anthropic
Claude Haiku 5.5Med → High+143×3.0Anthropic
Claude Haiku 5.5High → Xhigh+93×3.0Anthropic
Claude Haiku 5.5Xhigh → Max+107×3.22Anthropic
GPT-6 LunaLow → Med+226×5.0not stated
GPT-6 LunaMed → High+82×1.5not stated
GPT-6 LunaHigh → Xhigh+20×1.67not stated
GPT-6 LunaXhigh → Max+73×1.8not stated

official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)

No frontier can be shown because no points have source costs.

Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Fable 5.2Xhigh → Max+80—Artificial Analysis

AA-Briefcase v1.1(Elo)

official results (Introducing Claude Sonnet 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Sonnet 5.5Low1,264$0.87Cost per taskAnthropic
Claude Opus 5.5Low1,285$1.15Cost per taskAnthropic
Claude Sonnet 5.5Med1,461$1.64Cost per taskAnthropic
Claude Sonnet 5.5High1,634$3.95Cost per taskAnthropic
Claude Opus 5.5Med1,642$4.40Cost per taskAnthropic
Claude Opus 5.5High1,705$6.27Cost per taskAnthropic
Claude Sonnet 5.5Xhigh1,746$9.63Cost per taskAnthropic
Claude Opus 5.5Xhigh1,780$12.27Cost per taskAnthropic
Claude Opus 5.5Max1,822$21.05Cost per taskAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5Low → Med+357×3.83Anthropic
Claude Opus 5.5Med → High+63×1.42Anthropic
Claude Opus 5.5High → Xhigh+75×1.96Anthropic
Claude Opus 5.5Xhigh → Max+42×1.72Anthropic
Claude Sonnet 5.5Low → Med+197×1.89Anthropic
Claude Sonnet 5.5Med → High+173×2.41Anthropic
Claude Sonnet 5.5High → Xhigh+112×2.44Anthropic
Claude Sonnet 5.5Xhigh → Max+65×3.03Anthropic

AutomationBench

official results (Introducing Claude Opus 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low23.3%$0.50Cost per taskZapier
Claude Opus 5.5Med28.6%$0.64Cost per taskZapier
Claude Opus 5.5High32.0%$0.70Cost per taskZapier
Claude Opus 5.5Xhigh34.4%$0.86Cost per taskZapier
Claude Opus 5.5Max40.0%$1.37Cost per taskZapier
GPT-6 AstraMax41.4%$1.77Cost per taskZapier
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5Low → Med+5.3pt×1.28Zapier
Claude Opus 5.5Med → High+3.4pt×1.09Zapier
Claude Opus 5.5High → Xhigh+2.4pt×1.23Zapier
Claude Opus 5.5Xhigh → Max+5.6pt×1.59Zapier
GPT-6 AstraLow → Med+3.8pt×1.19Zapier
GPT-6 AstraMed → High+3.0pt×1.13Zapier
GPT-6 AstraHigh → Xhigh+1.9pt×1.06Zapier
GPT-6 AstraXhigh → Max+2.4pt×1.16Zapier

Humanity's Last Exam (with tools)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low57.4%$0.08Cost per attemptAnthropic
Claude Opus 5.5Med63.0%$0.17Cost per attemptAnthropic
Claude Fable 5.2Low68.4%$0.19Cost per attemptAnthropic
Claude Fable 5.2Med68.6%$0.21Cost per attemptAnthropic
Claude Fable 5.2High71.5%$0.63Cost per attemptAnthropic
Claude Fable 5.2Xhigh73.4%$1.48Cost per attemptAnthropic
Claude Fable 5.2Max74.2%$4.51Cost per attemptAnthropic

Points without source costs are excluded from the frontier (excluded: 1).

Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Fable 5.2Low → Med+0.2pt×1.11Anthropic
Claude Fable 5.2Med → High+2.9pt×3.0Anthropic
Claude Fable 5.2High → Xhigh+1.9pt×2.35Anthropic
Claude Fable 5.2Xhigh → Max+0.8pt×3.05Anthropic
Claude Opus 5.5Low → Med+5.6pt×2.13Anthropic
Claude Opus 5.5Med → High+0.9pt×1.71Anthropic
Claude Opus 5.5High → Xhigh+2.5pt×2.38Anthropic
Claude Opus 5.5Xhigh → Max+1.3pt×3.16Anthropic

Humanity's Last Exam (without tools)

official results (Introducing Claude Haiku 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Haiku 5.5Low30.9%$0.003Cost per attemptAnthropic
Claude Haiku 5.5Med35.5%$0.007Cost per attemptAnthropic
Claude Haiku 5.5High39.7%$0.02Cost per attemptAnthropic
Claude Sonnet 5.5Med43.2%$0.03Cost per attemptAnthropic
Claude Haiku 5.5Xhigh44.1%$0.06Cost per attemptAnthropic
Claude Sonnet 5.5High47.9%$0.08Cost per attemptAnthropic
Claude Sonnet 5.5Xhigh53.0%$0.20Cost per attemptAnthropic
Claude Sonnet 5.5Max56.9%$0.89Cost per attemptAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Sonnet 5.5Low → Med+1.8pt×1.0Anthropic
Claude Sonnet 5.5Med → High+4.7pt×2.67Anthropic
Claude Sonnet 5.5High → Xhigh+5.1pt×2.5Anthropic
Claude Sonnet 5.5Xhigh → Max+3.9pt×4.45Anthropic
Claude Haiku 5.5Low → Med+4.6pt×2.33Anthropic
Claude Haiku 5.5Med → High+4.2pt×2.86Anthropic
Claude Haiku 5.5High → Xhigh+4.4pt×3.0Anthropic
Claude Haiku 5.5Xhigh → Max+1.8pt×3.5Anthropic

OSWorld 2.1(offline subset)

official results (Introducing Claude Haiku 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
GPT-6 LunaLow19.2%$0.04Cost per attemptnot stated
Claude Haiku 5.5Low42.0%$0.07Cost per attemptAnthropic
Claude Haiku 5.5Med53.3%$0.13Cost per attemptAnthropic
Claude Haiku 5.5High61.3%$0.18Cost per attemptAnthropic
Claude Haiku 5.5Xhigh67.6%$0.28Cost per attemptAnthropic
Claude Haiku 5.5Max72.4%$0.61Cost per attemptAnthropic
Claude Sonnet 5.5High73.2%$1.38Cost per attemptAnthropic
Claude Sonnet 5.5Xhigh81.1%$2.22Cost per attemptAnthropic
Claude Sonnet 5.5Max83.9%$5.73Cost per attemptAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Sonnet 5.5Low → Med+8.1pt×1.37Anthropic
Claude Sonnet 5.5Med → High+7.2pt×1.48Anthropic
Claude Sonnet 5.5High → Xhigh+7.9pt×1.61Anthropic
Claude Sonnet 5.5Xhigh → Max+2.8pt×2.58Anthropic
Claude Haiku 5.5Low → Med+11.3pt×1.86Anthropic
Claude Haiku 5.5Med → High+8.0pt×1.38Anthropic
Claude Haiku 5.5High → Xhigh+6.3pt×1.56Anthropic
Claude Haiku 5.5Xhigh → Max+4.8pt×2.18Anthropic
GPT-6 LunaLow → Med+18.3pt×3.25not stated
GPT-6 LunaMed → High+4.8pt×1.08not stated
GPT-6 LunaHigh → Xhigh+2.5pt×1.21not stated
GPT-6 LunaXhigh → Max+4.1pt×1.18not stated

Chartography (without tools)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low57.0%$0.02Cost per attemptAnthropic
Claude Fable 5.2Med66.4%$0.03Cost per attemptAnthropic
Claude Fable 5.2High69.8%$0.07Cost per attemptAnthropic
Claude Fable 5.2Xhigh71.4%$0.15Cost per attemptAnthropic
Claude Fable 5.2Max73.4%$0.75Cost per attemptAnthropic

Points without source costs are excluded from the frontier (excluded: 1).

Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Fable 5.2Low → Med+2.2pt×1.0Anthropic
Claude Fable 5.2Med → High+3.4pt×2.33Anthropic
Claude Fable 5.2High → Xhigh+1.6pt×2.14Anthropic
Claude Fable 5.2Xhigh → Max+2.0pt×5.0Anthropic
Claude Opus 5.5Low → Med+2.0pt×1.5Anthropic
Claude Opus 5.5Med → High+0.2pt×1.0Anthropic
Claude Opus 5.5High → Xhigh+3.2pt×2.67Anthropic
Claude Opus 5.5Xhigh → Max+2.0pt×6.13Anthropic

WANDR

official results (Introducing Claude Opus 5.5)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low31.2%$1.20Cost per attemptAnthropic
Claude Opus 5.5Med62.8%$11.20Cost per attemptAnthropic
Claude Opus 5.5High67.3%$16.88Cost per attemptAnthropic
Claude Opus 5.5Xhigh71.3%$29.06Cost per attemptAnthropic
Claude Opus 5.5Max72.3%$37.92Cost per attemptAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5Low → Med+31.6pt×9.33Anthropic
Claude Opus 5.5Med → High+4.5pt×1.51Anthropic
Claude Opus 5.5High → Xhigh+4.0pt×1.72Anthropic
Claude Opus 5.5Xhigh → Max+1.0pt×1.3Anthropic

WANDR(relaxed score)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low31.2%$1.25Cost per attemptAnthropic
Claude Opus 5.5Med62.8%$11.40Cost per attemptAnthropic
Claude Fable 5.2Low71.4%$12.66Cost per attemptAnthropic
Claude Fable 5.2Med73.6%$15.71Cost per attemptAnthropic
Claude Fable 5.2High79.3%$29.20Cost per attemptAnthropic
Claude Fable 5.2Xhigh80.6%$39.84Cost per attemptAnthropic
Claude Fable 5.2Max82.1%$53.11Cost per attemptAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Fable 5.2Low → Med+2.2pt×1.24Anthropic
Claude Fable 5.2Med → High+5.7pt×1.86Anthropic
Claude Fable 5.2High → Xhigh+1.3pt×1.36Anthropic
Claude Fable 5.2Xhigh → Max+1.5pt×1.33Anthropic
Claude Opus 5.5Low → Med+31.6pt×9.12Anthropic
Claude Opus 5.5Med → High+4.5pt×1.52Anthropic
Claude Opus 5.5High → Xhigh+4.0pt×1.69Anthropic
Claude Opus 5.5Xhigh → Max+1.0pt×1.32Anthropic

BenchCAD 2.1 (with tools)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low6.3$0.03Cost per attemptAnthropic
Claude Opus 5.5Med19.1$1.11Cost per attemptAnthropic
Claude Fable 5.2Low26.9$1.89Cost per attemptAnthropic
Claude Opus 5.5High29.7$2.57Cost per attemptAnthropic
Claude Fable 5.2Med32.4$2.66Cost per attemptAnthropic
Claude Opus 5.5Xhigh54.5$8.91Cost per attemptAnthropic
Claude Fable 5.2High61$9.99Cost per attemptAnthropic
Claude Opus 5.5Max65.3$19.86Cost per attemptAnthropic
Claude Fable 5.2Xhigh74.1$23.23Cost per attemptAnthropic
Claude Fable 5.2Max83.5$50.77Cost per attemptAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Fable 5.2Low → Med+5.5×1.41Anthropic
Claude Fable 5.2Med → High+28.6×3.76Anthropic
Claude Fable 5.2High → Xhigh+13.1×2.33Anthropic
Claude Fable 5.2Xhigh → Max+9.4×2.19Anthropic
Claude Opus 5.5Low → Med+12.8×37.0Anthropic
Claude Opus 5.5Med → High+10.6×2.32Anthropic
Claude Opus 5.5High → Xhigh+24.8×3.47Anthropic
Claude Opus 5.5Xhigh → Max+10.8×2.23Anthropic

CVE Rediscovery

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

Points on the frontier (lowest cost first)
Models on the frontiereffortScoreSource cost (metric)measured/reported by
Claude Opus 5.5Low59.4%$0.11Cost per attemptAnthropic
Claude Opus 5.5Med66.1%$0.28Cost per attemptAnthropic
Claude Opus 5.5High70.0%$0.43Cost per attemptAnthropic
Claude Opus 5.5Xhigh76.4%$1.05Cost per attemptAnthropic
Claude Opus 5.5Max81.3%$2.98Cost per attemptAnthropic
Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5Low → Med+6.7pt×2.55Anthropic
Claude Opus 5.5Med → High+3.9pt×1.54Anthropic
Claude Opus 5.5High → Xhigh+6.4pt×2.44Anthropic
Claude Opus 5.5Xhigh → Max+4.9pt×2.84Anthropic

FrontierMath Tier 4(v2)

third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0)

No frontier can be shown because no points have source costs.

Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
GPT-6 AstraLow → Med+9.8pt—Epoch AI
GPT-6 AstraMed → High±0.0pt—Epoch AI
GPT-6 AstraHigh → Xhigh±0.0pt—Epoch AI
GPT-6 AstraXhigh → Max±0.0pt—Epoch AI

OTIS Mock AIME 2024-2025

third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, otis_mock_aime_2024_2025.csv) CC BY 4.0)

No frontier can be shown because no points have source costs.

Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Haiku 5.5High → Xhigh+1.7pt—Epoch AI

Chess Puzzles(Epoch AI)

third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0)

No frontier can be shown because no points have source costs.

Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Haiku 5.5Low → MaxNo value for Med · High · Xhigh+31.0pt—Epoch AI

MirrorCode

third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0)

No frontier can be shown because no points have source costs.

Changes with increasing effort
ModeleffortScore differenceCost ratiomeasured/reported by
Claude Opus 5.5High → MaxNo value for Xhigh+16.7pt—Epoch AI
GPT-6 AstraHigh → MaxNo value for Xhigh+13.3pt—Epoch AI

By metric

Benchmarks are ordered by category and ranked within each comparison group (the same source, or sources verified to use the same measurement conditions). “measured/reported by” identifies the party stated in the source as measuring or reporting the value. Even in official announcements, the publisher may have measured values for other companies’ models.

Agentic codingTerminal-Bench 4.0

official results (Accuracy vs Cost figure announced by Anthropic (Opus 5.5 and Sonnet 5.5 pages))

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5Max70.6%$12.54Cost per attemptfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
2Claude Opus 5.5Xhigh66.4%$7.35Cost per attemptfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
3Claude Opus 5.5Max64.8%$11.24Cost per attempt—AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
4Claude Opus 5.5High64.2%$3.88Cost per attemptfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
5Claude Sonnet 5.5Xhigh61.5%$5.30Cost per attempt—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
6GPT-6 AstraHigh57.9%$7.21Cost per attempt—OpenAIIntroducing Claude Opus 5.5Retrieved 2026-11-12
7Claude Opus 5.5Med57.6%$2.94Cost per attemptfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
7GPT-6 AstraXhigh57.6%$7.48Cost per attempt—OpenAIIntroducing Claude Opus 5.5Retrieved 2026-11-12
9GPT-6 AstraMax56.7%$10.35Cost per attempt—OpenAIIntroducing Claude Opus 5.5Retrieved 2026-11-12
10GPT-6 AstraMed53.9%$6.15Cost per attempt—OpenAIIntroducing Claude Opus 5.5Retrieved 2026-11-12
11GPT-6 AstraLow49.7%$4.95Cost per attempt—OpenAIIntroducing Claude Opus 5.5Retrieved 2026-11-12
12Claude Sonnet 5.5High43.0%$1.94Cost per attemptfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
13Claude Opus 5.5Low38.5%$1.29Cost per attemptfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
14Claude Sonnet 5.5Med28.8%$0.83Cost per attemptfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
15Claude Sonnet 5.5Low20.0%$0.76Cost per attemptfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5Max70.6%$10.44Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
2Claude Sonnet 5.5Xhigh61.5%$4.34Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
3Claude Sonnet 5.5High43.0%$1.46Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
4Claude Haiku 5.5Max39.2%$2.64Cost per attempt—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
5Claude Haiku 5.5Xhigh31.5%$1.75Cost per attempt—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
6Claude Sonnet 5.5Med28.8%$0.68Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
7Claude Haiku 5.5High24.8%$1.04Cost per attempt—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
8Claude Haiku 5.5Med20.3%$0.68Cost per attempt—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
9Claude Sonnet 5.5Low20.0%$0.62Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
10GPT-6 Lunanot stated16.4%——not statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12
11Claude Haiku 5.5Low12.7%$0.42Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12

official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max67.6%——AnthropicClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14

Agentic codingTerminal-Bench-Science 0.1

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1GPT-6 Astranot stated64.6%——OpenAIIntroducing Claude Opus 5.5Retrieved 2026-11-12
2Claude Opus 5.5Max58.7%——AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2not stated74.6%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2GPT-6 Astranot stated68.1%——not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3Claude Opus 5.5not stated58.7%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

official results (Claude Sonnet 5.5 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5Max59.9%——AnthropicClaude Sonnet 5.5 System CardRetrieved 2026-11-14

official results (Claude Haiku 5.5 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1GPT-6.1 SolMax57.0%——OpenAIClaude Haiku 5.5 System CardRetrieved 2026-11-14
2Claude Haiku 5.5Max20.6%——AnthropicClaude Haiku 5.5 System CardRetrieved 2026-11-14

Agentic codingFrontierCode v1.1(main set)

official results (Accuracy vs Cost figure announced by Anthropic (Opus 5.5 and Sonnet 5.5 pages))

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Med54.6%$0.80Cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
2Claude Opus 5.5Max54.4%$6.19Cost per task—AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
3Claude Opus 5.5High54.0%$1.09Cost per task—AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
4GPT-6 AstraMax53.3%$4.36Cost per task—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
5Claude Sonnet 5.5Xhigh52.1%$1.59Cost per task—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
6Claude Opus 5.5Xhigh51.4%$2.25Cost per task—AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
7GPT-6 AstraHigh50.9%$2.85Cost per task—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
8GPT-6 AstraXhigh50.6%$3.10Cost per task—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
9Claude Sonnet 5.5High49.4%$0.42Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
10GPT-6 AstraMed48.8%$2.28Cost per task—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
11Claude Opus 5.5Low47.3%$0.40Cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
12Claude Sonnet 5.5Max46.2%$20.78Cost per task—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
13GPT-6 AstraLow45.3%$1.59Cost per task—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
14Claude Sonnet 5.5Med36.5%$0.24Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
15Claude Sonnet 5.5Low29.3%$0.19Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5Xhigh52.1%——AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
2Claude Haiku 5.5not stated46.4%——AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
3GPT-6 Lunanot stated42.4%——not statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12

Agentic codingFrontierCode 2.0

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Xhigh49.1%$14.19Cost per taskfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Fable 5.2Max45.6%$44.70Cost per task—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3Claude Opus 5.5Max45.5%$12.82Cost per taskfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
4Claude Fable 5.2High45.3%$6.72Cost per taskfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
5Claude Opus 5.5Xhigh43.4%$5.18Cost per taskfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
6GPT-6 AstraMax42.8%$6.68Cost per task—not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
7GPT-6 AstraXhigh41.4%$4.54Cost per taskfrontiernot statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
8GPT-6 AstraHigh38.3%$4.28Cost per taskfrontiernot statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
9Claude Fable 5.2Med37.6%$2.48Cost per taskfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
10GPT-6 AstraMed36.8%$3.49Cost per task—not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
11Claude Opus 5.5High34.5%$2.42Cost per taskfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
12Claude Fable 5.2Low34.2%$2.10Cost per taskfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
13GPT-6 AstraLow31.1%$2.44Cost per task—not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
14Claude Opus 5.5Med30.1%$1.70Cost per taskfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
15Claude Opus 5.5Low14.7%$0.75Cost per taskfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

Agentic codingFrontierSWE 2

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2not stated69.9%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2GPT-6 Astranot stated65.5%——not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3Claude Opus 5.5not stated62.3%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

official results (Claude Sonnet 5.5 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5Max61.9%——ProximalClaude Sonnet 5.5 System CardRetrieved 2026-11-14

official results (Claude Haiku 5.5 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Haiku 5.5Max43.8%——ProximalClaude Haiku 5.5 System CardRetrieved 2026-11-14

Agentic codingCursorBench 4.0

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max57.8%$13.43Cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
2Claude Opus 5.5High56.0%$3.97Cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
2Claude Opus 5.5Xhigh56.0%$6.99Cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
4Claude Opus 5.5Med52.5%$2.90Cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
5Claude Opus 5.5Low43.7%$1.18Cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12

official results (Introducing Claude Sonnet 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max57.8%$13.43Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
2Claude Opus 5.5High56.0%$3.97Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
2Claude Opus 5.5Xhigh56.0%$6.98Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
4Claude Sonnet 5.5Max55.5%$9.67Cost per task—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
5Claude Sonnet 5.5Xhigh53.1%$3.88Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
6Claude Opus 5.5Med52.5%$2.91Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
7Claude Sonnet 5.5High47.8%$1.67Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
8Claude Opus 5.5Low43.7%$1.17Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
9Claude Sonnet 5.5Med39.2%$0.70Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
10Claude Sonnet 5.5Low35.8%$0.50Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12

official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max60.0%——CursorClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14
2Claude Fable 5.2High56.9%——CursorClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14
3Claude Fable 5.2Xhigh56.3%——CursorClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14
4Claude Fable 5.2Med54.8%——CursorClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14
5Claude Fable 5.2Low53.2%——CursorClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14

CodingMirrorCode

CodingLMArena Text Coding (without style control)

third-party results (lmarena-ai/leaderboard-dataset text/latest-00000-of-00001.parquet (CC BY 4.0))

ReasoningHumanity's Last Exam (with tools)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max74.2%$4.51Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Fable 5.2Xhigh73.4%$1.48Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3Claude Fable 5.2High71.5%$0.63Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
4Claude Fable 5.2Med68.6%$0.21Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
5Claude Fable 5.2Low68.4%$0.19Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
6Claude Opus 5.5Max67.7%$2.18Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
7Claude Opus 5.5Xhigh66.4%$0.69Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
8Claude Opus 5.5High63.9%$0.29Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
9Claude Opus 5.5Med63.0%$0.17Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
10Claude Opus 5.5Low57.4%$0.08Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
11GPT-6 Astranot stated57.2%——not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max67.7%——AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
2GPT-6 Astranot stated57.2%——not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12

official results (Introducing Claude Sonnet 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5not stated67.7%——AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
2Claude Sonnet 5.5not stated64.5%——AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5not stated64.5%——AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
2Claude Haiku 5.5not stated57.4%——AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12

ReasoningHumanity's Last Exam (without tools)

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5Max56.9%$0.89Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
2Claude Sonnet 5.5Xhigh53.0%$0.20Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
3Claude Sonnet 5.5High47.9%$0.08Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
4Claude Haiku 5.5Max45.9%$0.21Cost per attempt—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
5Claude Haiku 5.5Xhigh44.1%$0.06Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
6Claude Sonnet 5.5Med43.2%$0.03Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
7Claude Sonnet 5.5Low41.4%$0.03Cost per attempt—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
8Claude Haiku 5.5High39.7%$0.02Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
9Claude Haiku 5.5Med35.5%$0.007Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
10Claude Haiku 5.5Low30.9%$0.003Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12

official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max73.2%——AnthropicClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14

official results (Claude Opus 5.5 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max64.4%——AnthropicClaude Opus 5.5 System CardRetrieved 2026-11-14

ReasoningGPQA Diamond

ReasoningChess Puzzles(Epoch AI)

MathFrontierMath Tiers 1-3(v2)

MathFrontierMath Tier 4(v2)

third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max100.0%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
1GPT-6.1 SolMax100.0%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
3GPT-6 AstraHigh97.6%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
3GPT-6 AstraXhigh97.6%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
3GPT-6 AstraMax97.6%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
6GPT-6 AstraMed97.6%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
7Claude Opus 5.5Max95.0%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
8GPT-6.1 TerraMax92.7%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
9GPT-6 AstraLow87.8%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
10GPT-6 Astranot stated82.9%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
11Claude Sonnet 5.5Max80.5%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
12GPT-6 LunaMax56.1%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12
13Claude Haiku 5.5Max46.3%——Epoch AIEpoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tier_4_v2.csv) CC BY 4.0Retrieved 2026-11-12

MathOTIS Mock AIME 2024-2025

third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, otis_mock_aime_2024_2025.csv) CC BY 4.0)

KnowledgeGDPval-AA v2.1

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max1,846$8.92Estimated cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
2Claude Opus 5.5Xhigh1,820$4.21Estimated cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
3Claude Opus 5.5High1,692$1.54Estimated cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
4Claude Opus 5.5Med1,576$0.86Estimated cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
5GPT-6 AstraMax1,542$4.53Estimated cost per task—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
6GPT-6 AstraXhigh1,516$3.04Estimated cost per task—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
7GPT-6 AstraHigh1,485$2.43Estimated cost per task—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
8GPT-6 AstraMed1,468$1.82Estimated cost per task—not statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
9GPT-6 AstraLow1,366$0.85Estimated cost per taskfrontiernot statedIntroducing Claude Opus 5.5Retrieved 2026-11-12
10Claude Opus 5.5Low1,224$0.21Estimated cost per taskfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5Max1,840$6.78Cost per taskfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
2Claude Sonnet 5.5Xhigh1,731$1.88Cost per taskfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
3Claude Haiku 5.5Max1,620$0.87Cost per taskfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
4Claude Sonnet 5.5High1,551$0.62Cost per taskfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
5Claude Haiku 5.5Xhigh1,513$0.27Cost per taskfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
6GPT-6 LunaMax1,437$0.09Cost per taskfrontiernot statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12
7Claude Haiku 5.5High1,420$0.09Cost per task—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
8GPT-6 LunaXhigh1,364$0.05Cost per taskfrontiernot statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12
9GPT-6 LunaHigh1,344$0.03Cost per taskfrontiernot statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12
10Claude Sonnet 5.5Med1,324$0.27Cost per task—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
11Claude Haiku 5.5Med1,277$0.03Cost per task—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
12GPT-6 LunaMed1,262$0.02Cost per taskfrontiernot statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12
13Claude Sonnet 5.5Low1,179$0.22Cost per task—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
14Claude Haiku 5.5Low1,125$0.01Cost per taskfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
15GPT-6 LunaLow1,036$0.004Cost per taskfrontiernot statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12

official results (Introducing Claude Sonnet 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5not stated1,846——Artificial AnalysisIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
2Claude Sonnet 5.5not stated1,844——Artificial AnalysisIntroducing Claude Sonnet 5.5Retrieved 2026-11-12

official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max1,831——Artificial AnalysisClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14
2Claude Fable 5.2Xhigh1,751——Artificial AnalysisClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14
3GPT-6.1 Solnot stated1,609——Artificial AnalysisClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14

KnowledgeAA-Briefcase v1.1(Elo)

official results (Introducing Claude Sonnet 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max1,822$21.05Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
2Claude Sonnet 5.5Max1,811$29.19Cost per task—AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
3Claude Opus 5.5Xhigh1,780$12.27Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
4Claude Sonnet 5.5Xhigh1,746$9.63Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
5Claude Opus 5.5High1,705$6.27Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
6Claude Opus 5.5Med1,642$4.40Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
7Claude Sonnet 5.5High1,634$3.95Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
8Claude Sonnet 5.5Med1,461$1.64Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
9Claude Opus 5.5Low1,285$1.15Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
10Claude Sonnet 5.5Low1,264$0.87Cost per taskfrontierAnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5not stated1,824——AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
2Claude Haiku 5.5not stated1,578——AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
3GPT-6 Lunanot stated1,336——not statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5not stated1,800——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Fable 5.2not stated1,785——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3GPT-6 Astranot stated1,569——not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1GPT-6.1 Solnot stated1,555——Artificial AnalysisClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14

KnowledgeAA-Briefcase v1.1(rubric)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2not stated66.1%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Opus 5.5not stated61.2%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3GPT-6 Astranot stated52.0%——not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

KnowledgeRemote Labor Index(RLI)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2High41.3%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Opus 5.5not stated21.3%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3GPT-6 Astranot stated20.8%——not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

KnowledgeHealthBench Professional (length-adjusted score)

official results (GPT-6 Astra System Card (Table 6. HealthBench Evaluations))

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1GPT-6 Astranot stated64.7——OpenAIGPT-6 Astra System Card (Table 6. HealthBench Evaluations)Retrieved 2026-11-12

official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max67.7——Artificial AnalysisClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14
2Claude Sonnet 5.5Max63——Artificial AnalysisClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14
3Claude Opus 5.5Max59.9——Artificial AnalysisClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14
4Claude Haiku 5.5Max58.4——Artificial AnalysisClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14

official results (Addendum to GPT-6 Astra System Card: GPT-6.1 Terra)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1GPT-6.1 Solnot stated64.2——OpenAIAddendum to GPT-6 Astra System Card: GPT-6.1 TerraRetrieved 2026-11-14
2GPT-6.1 Terranot stated62.7——OpenAIAddendum to GPT-6 Astra System Card: GPT-6.1 TerraRetrieved 2026-11-14
3GPT-6 Lunanot stated60.8——OpenAIAddendum to GPT-6 Astra System Card: GPT-6.1 TerraRetrieved 2026-11-14

KnowledgeHealthBench Hard (length-adjusted score)

official results (GPT-6 Astra System Card (Table 6. HealthBench Evaluations))

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1GPT-6 Astranot stated36.6——OpenAIGPT-6 Astra System Card (Table 6. HealthBench Evaluations)Retrieved 2026-11-12

official results (Addendum to GPT-6 Astra System Card: GPT-6.1 Terra)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1GPT-6.1 Solnot stated36.2——OpenAIAddendum to GPT-6 Astra System Card: GPT-6.1 TerraRetrieved 2026-11-14
2GPT-6.1 Terranot stated31.4——OpenAIAddendum to GPT-6 Astra System Card: GPT-6.1 TerraRetrieved 2026-11-14
2GPT-6 Lunanot stated31.4——OpenAIAddendum to GPT-6 Astra System Card: GPT-6.1 TerraRetrieved 2026-11-14

KnowledgeSimpleQA Verified

MultimodalChartography (with tools)

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max89.0%——AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12

official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max91.6%——AnthropicClaude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14

official results (Claude Sonnet 5.5 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5Max90.2%——AnthropicClaude Sonnet 5.5 System CardRetrieved 2026-11-14

official results (Claude Haiku 5.5 System Card)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Haiku 5.5Max86.2%——AnthropicClaude Haiku 5.5 System CardRetrieved 2026-11-14

MultimodalChartography (without tools)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max73.4%$0.75Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Fable 5.2Xhigh71.4%$0.15Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3GPT-6 Astranot stated71.0%——not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
4Claude Fable 5.2High69.8%$0.07Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
5Claude Fable 5.2Med66.4%$0.03Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
6Claude Opus 5.5Max64.4%$0.49Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
7Claude Fable 5.2Low64.2%$0.03Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
8Claude Opus 5.5Xhigh62.4%$0.08Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
9Claude Opus 5.5High59.2%$0.03Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
10Claude Opus 5.5Med59.0%$0.03Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
11Claude Opus 5.5Low57.0%$0.02Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

official results (Introducing Claude Sonnet 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5not stated64.4%——AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
2Claude Sonnet 5.5not stated61.6%——AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5not stated61.6%——AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
2Claude Haiku 5.5not stated46.4%——AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
3GPT-6 Lunanot stated29.1%——not statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12

Tool useAutomationBench

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1GPT-6 AstraMax41.4%$1.77Cost per taskfrontierZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12
2Claude Opus 5.5Max40.0%$1.37Cost per taskfrontierZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12
3GPT-6 AstraXhigh39.0%$1.53Cost per task—ZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12
4GPT-6 AstraHigh37.1%$1.45Cost per task—ZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12
5Claude Opus 5.5Xhigh34.4%$0.86Cost per taskfrontierZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12
6GPT-6 AstraMed34.1%$1.28Cost per task—ZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12
7Claude Opus 5.5High32.0%$0.70Cost per taskfrontierZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12
8GPT-6 AstraLow30.3%$1.08Cost per task—ZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12
9Claude Opus 5.5Med28.6%$0.64Cost per taskfrontierZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12
10Claude Opus 5.5Low23.3%$0.50Cost per taskfrontierZapierIntroducing Claude Opus 5.5Retrieved 2026-11-12

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2not stated51.4%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Opus 5.5not stated42.5%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3GPT-6 Astranot stated41.4%——not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

Tool useWANDR

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max72.3%$37.92Cost per attemptfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
2Claude Opus 5.5Xhigh71.3%$29.06Cost per attemptfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
3Claude Opus 5.5High67.3%$16.88Cost per attemptfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
4Claude Opus 5.5Med62.8%$11.20Cost per attemptfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12
5Claude Opus 5.5Low31.2%$1.20Cost per attemptfrontierAnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12

Tool useWANDR(relaxed score)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max82.1%$53.11Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Fable 5.2Xhigh80.6%$39.84Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3Claude Fable 5.2High79.3%$29.20Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
4Claude Fable 5.2Med73.6%$15.71Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
5Claude Opus 5.5Max72.3%$38.68Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
6Claude Fable 5.2Low71.4%$12.66Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
7Claude Opus 5.5Xhigh71.3%$29.25Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
8Claude Opus 5.5High67.3%$17.31Cost per attempt—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
9Claude Opus 5.5Med62.8%$11.40Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
10Claude Opus 5.5Low31.2%$1.25Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

Computer useOSWorld 2.1(partial)

official results (Introducing Claude Opus 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max81.8%——AnthropicIntroducing Claude Opus 5.5Retrieved 2026-11-12

official results (Introducing Claude Sonnet 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5not stated81.8%——AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12
2Claude Sonnet 5.5not stated80.1%——AnthropicIntroducing Claude Sonnet 5.5Retrieved 2026-11-12

Computer useOSWorld 2.1(offline subset)

official results (Introducing Claude Haiku 5.5)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Sonnet 5.5Max83.9%$5.73Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
2Claude Sonnet 5.5Xhigh81.1%$2.22Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
3Claude Sonnet 5.5High73.2%$1.38Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
4Claude Haiku 5.5Max72.4%$0.61Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
5Claude Haiku 5.5Xhigh67.6%$0.28Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
6Claude Sonnet 5.5Med66.0%$0.93Cost per attempt—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
7Claude Haiku 5.5High61.3%$0.18Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
8Claude Sonnet 5.5Low57.9%$0.68Cost per attempt—AnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
9Claude Haiku 5.5Med53.3%$0.13Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
10GPT-6 LunaMax48.9%$0.20Cost per attempt—not statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12
11GPT-6 LunaXhigh44.8%$0.17Cost per attempt—not statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12
12GPT-6 LunaHigh42.3%$0.14Cost per attempt—not statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12
13Claude Haiku 5.5Low42.0%$0.07Cost per attemptfrontierAnthropicIntroducing Claude Haiku 5.5Retrieved 2026-11-12
14GPT-6 LunaMed37.5%$0.13Cost per attempt—not statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12
15GPT-6 LunaLow19.2%$0.04Cost per attemptfrontiernot statedIntroducing Claude Haiku 5.5Retrieved 2026-11-12

Computer useOSWorld 2.1 (offline set, partial)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2not stated89.3%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Opus 5.5not stated87.2%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3GPT-6 Astranot stated79.5%——not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

WritingLMArena Text (style control, overall)

third-party results (lmarena-ai/leaderboard-dataset text_style_control/latest-00000-of-00001.parquet (CC BY 4.0))

OtherBenchCAD 2.1 (with tools)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2Max83.5$50.77Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Fable 5.2Xhigh74.1$23.23Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3Claude Opus 5.5Max65.3$19.86Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
4Claude Fable 5.2High61$9.99Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
5Claude Opus 5.5Xhigh54.5$8.91Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
6Claude Fable 5.2Med32.4$2.66Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
7Claude Opus 5.5High29.7$2.57Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
8Claude Fable 5.2Low26.9$1.89Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
9Claude Opus 5.5Med19.1$1.11Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
10Claude Opus 5.5Low6.3$0.03Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

OtherCVE Rediscovery

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5Max81.3%$2.98Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Opus 5.5Xhigh76.4%$1.05Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3Claude Opus 5.5High70.0%$0.43Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
4Claude Opus 5.5Med66.1%$0.28Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
5Claude Opus 5.5Low59.4%$0.11Cost per attemptfrontierAnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

OtherCyScenarioBench

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5not stated67.6%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

OtherDe novo binder design (24 hours)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Opus 5.5not stated82.6——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

OtherRoboDojo Sim

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2not stated64.9%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
2Claude Opus 5.5not stated39.4%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12
3GPT-6 Astranot stated29.8%——AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12

OtherEpoch Capabilities Index(ECI)

third-party results (Epoch AI, epoch_capabilities_index/eci_scores.csv (CC BY 4.0))

RankModeleffortScoreSource cost (metric)frontiermeasured/reported bysource
1Claude Fable 5.2not stated173.44——Epoch AIEpoch AI, epoch_capabilities_index/eci_scores.csv (CC BY 4.0)Retrieved 2026-11-12
2GPT-6 Astranot stated169——Epoch AIEpoch AI, epoch_capabilities_index/eci_scores.csv (CC BY 4.0)Retrieved 2026-11-12
3Claude Opus 5.5not stated168.54——Epoch AIEpoch AI, epoch_capabilities_index/eci_scores.csv (CC BY 4.0)Retrieved 2026-11-12
4GPT-6.1 Solnot stated168.48——Epoch AIEpoch AI, epoch_capabilities_index/eci_scores.csv (CC BY 4.0)Retrieved 2026-11-12
5GPT-6.1 Terranot stated167.67——Epoch AIEpoch AI, epoch_capabilities_index/eci_scores.csv (CC BY 4.0)Retrieved 2026-11-12
6Claude Sonnet 5.5not stated166.56——Epoch AIEpoch AI, epoch_capabilities_index/eci_scores.csv (CC BY 4.0)Retrieved 2026-11-12
7Claude Haiku 5.5not stated160.43——Epoch AIEpoch AI, epoch_capabilities_index/eci_scores.csv (CC BY 4.0)Retrieved 2026-11-12
8GPT-6 Lunanot stated156.41——Epoch AIEpoch AI, epoch_capabilities_index/eci_scores.csv (CC BY 4.0)Retrieved 2026-11-12