AI model × effort benchmark comparison
Cost and score, by effort.Compare models and effort by cost and score
Explore published benchmark results by model and effort to help choose models and effort in Claude Code or Codex. Every value has a source.
- Claude Fable 5.2
- Claude Mythos 5.2
- Claude Opus 5.5
- Claude Sonnet 5.5
- Claude Haiku 5.5
- Claude Fable 5.1
- Claude Mythos 5.1
- Claude Fable 5
- Claude Opus 5
- Claude Opus 4.8
- Claude Opus 4.7
- Claude Opus 4.6
- Claude Opus 4.5
- Claude Sonnet 5
- Claude Sonnet 4.6
- Claude Sonnet 4.5
- Claude Haiku 4.5
- GPT-6 Astra
- GPT-6.1 Sol
- GPT-6.1 Terra
- GPT-6 Luna
- GPT-6 Sol
- GPT-5.6 Sol
- GPT-5.6 Terra
- GPT-5.6 Luna
- GPT-5.5
- GPT-5.4
- GPT-5.2
- Gemini 4 Carbon
- Gemini 4 Argon
- Gemini 3.8 Flash
- Gemini 3.6 Flash
- Gemini 3.5 Flash-Lite
- Gemini 3.1 Pro Preview
- Gemini 3.1 Flash-Lite
- Gemini 3 Flash Preview
- Gemini 2.5 Pro
- Gemini 2.5 Flash
- Gemini 3.7 Flash
- Gemini 3.5 Flash
- Gemini 3 Pro Preview
- Grok 4.7
- Grok 4.6
- Grok 4.5
- DeepSeek-V4-Pro-0813
- DeepSeek-V4.1-Flash-1017
- DeepSeek-V4.1-Flash
- GLM-5.3
- GLM-5.3-Flash
- GLM-5.2
- GLM-5
- Kimi K3.1 Pro
- Kimi K3
- Mistral Large 4
- Qwen3.8-Max
- Qwen3.8-27B
- Qwen3.5-397B-A17B
Find models in the table, where each model name links to its page.
- Models to compare
- 57total
- Benchmarks
- 104total
- Data retrieved(latest)
- 2026-11-14
Cost and score chart
Points for the same model are connected in order of increasing effort. On the cost axis, points nearer the upper left are cheaper and score higher. See “How to read the chart” below.
Terminal-Bench 4.0
How to read the chart
- The y-axis shows score; the x-axis shows cost reported by the source (log scale) or effort order. On the cost axis, points nearer the upper left are cheaper and score higher.
- Costs are amounts reported by sources; metrics differ by source (per task, per trial, estimates, and so on). The metric appears on the axis, in tooltips, and in the data points table. Costs are not calculated from API prices. Points without source costs cannot be plotted on a logarithmic axis, so only their count is shown.
- Hollow points are approximate values read from source charts.
- Below the chart, counts of displayed points are grouped by the party identified in the source as measuring or reporting them. Even in official announcements, the publisher may have measured values for other companies’ models.
- Official announcements, third-party measurements, and papers use different conditions, so they are shown separately by source type. Even within a source type, results with different measurement conditions (such as harness or pass@1 / best-of-N) are placed in separate comparison groups.
Data points and sources for this chart
| Model | effort | Score | Source cost (metric) | measured/reported by | Extraction method | source | Retrieved |
|---|
Rankings
This aggregation compares models and entries with values for every benchmark in the set, using only third-party results. Models: 8; entries: 8; benchmarks: 4 (GPQA Diamond, FrontierMath Tiers 1-3(v2), FrontierMath Tier 4(v2), SimpleQA Verified). It is not an overall score for the entire site.
| Rank | Model (effort) | provider | Score (percentile) | Coverage | Price (input / output) |
|---|---|---|---|---|---|
| 1 | Claude Fable 5.2effort: MaxAnthropic · Coverage 6/10 · Price $8.00 / $40.00 | Anthropic | 84 | 6/10 | $8.00 / $40.00 |
| 1 | GPT-6 Astraeffort: MaxOpenAI · Coverage 9/10 · Price $10.00 / $50.00 | OpenAI | 84 | 9/10 | $10.00 / $50.00 |
| 3 | GPT-6.1 Soleffort: MaxOpenAI · Coverage 9/10 · Price $2.00 / $10.00 | OpenAI | 79 | 9/10 | $2.00 / $10.00 |
| 4 | Claude Opus 5.5effort: MaxAnthropic · Coverage 7/10 · Price $4.00 / $20.00 | Anthropic | 50 | 7/10 | $4.00 / $20.00 |
| 5 | GPT-6.1 Terraeffort: MaxOpenAI · Coverage 6/10 · Price $1.00 / $5.00 | OpenAI | 46 | 6/10 | $1.00 / $5.00 |
| 6 | Claude Sonnet 5.5effort: MaxAnthropic · Coverage 7/10 · Price $2.00 / $10.00 | Anthropic | 43 | 7/10 | $2.00 / $10.00 |
| 7 | GPT-6 Lunaeffort: MaxOpenAI · Coverage 9/10 · Price $0.10 / $0.50 | OpenAI | 14 | 9/10 | $0.10 / $0.50 |
| 8 | Claude Haiku 5.5effort: MaxAnthropic · Coverage 6/10 · Price $0.10 / $0.50 | Anthropic | 0 | 6/10 | $0.10 / $0.50 |
- Scores are rank percentiles within each comparison group (first = 100, last = 0), averaged within each benchmark and then across benchmarks. They are comparable only within this aggregation.
- Coverage is the number of benchmarks with a value for the model × effort / the number of benchmarks with third-party results.
- measured/reported by and counts for values in this aggregation: Epoch AI (32)
- Prices are USD per 1 million tokens (from each provider’s pricing table; they do not vary by effort). Sources are on the model pages.
- Rankings include only models currently available in Claude Code / Codex. Rankings including legacy and unavailable models are in All model rankings (records).
Compare by role
We choose benchmark categories to emphasize for each role and compare models available in Claude Code / Codex. Select a role for the Claude Code comparison, or use the links below for Codex.
- Advisor / design decisionsReasoning · Knowledge · MathModels available in Claude CodeModels available in Codex
- Manager / oversightCoding · ReasoningModels available in Claude CodeModels available in Codex
- Implementer / task executorAgentic coding · Coding · Tool useModels available in Claude CodeModels available in Codex
- Simple tasksCoding · Tool useModels available in Claude CodeModels available in Codex
- Design / UIDesign and UIModels available in Claude Code: no dataModels available in Codex: no data