FrontierMath Tiers 1-3(v2)
Epoch AI's private research-level mathematics problems, Tier 1-3 (v2).
- Category
- Math
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 1total
- Currently available model rankings · Ranked results: 8
- All models (records): Groups: 1 · Entries: 42
Rankings
Values with different source types (official, third-party, paper) or measurement conditions cannot be compared, so rankings are separated by comparison group (the same source, or sources verified to use the same conditions).
Rankings include only models currently available in Claude Code / Codex, excluding legacy models.
third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | Max | 95.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5.2 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-fable-5-2_max, Best score (across scorers)=0.9508771929824561, stderr=0.012824623769055387, Started at=2026-11-06T01:14:45.000Z |
| 2 | GPT-6.1 Sol | Max | 93.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-6.1-sol_max, Best score (across scorers)=0.9368421052631579, stderr=0.014434038295343787, Started at=2026-09-29T22:00:34.000Z |
| 2 | GPT-6 Astra | Max | 93.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Astra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-6-astra_max, Best score (across scorers)=0.9368421052631579, stderr=0.014434038295343787, Started at=2026-08-30T14:57:43.000Z |
| 4 | Claude Opus 5.5 | Max | 91.2% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-opus-5-5_max, Best score (across scorers)=0.9122807017543859, stderr=0.016786209858442095, Started at=2026-09-22T18:27:39.000Z |
| 5 | GPT-6.1 Terra | Max | 90.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Terra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-6.1-terra_max, Best score (across scorers)=0.9087719298245615, stderr=0.017085690144166794, Started at=2026-10-26T20:00:37.000Z |
| 6 | Claude Sonnet 5.5 | Max | 88.8% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-sonnet-5-5_max, Best score (across scorers)=0.887719298245614, stderr=0.018734030360524248, Started at=2026-09-29T15:15:14.000Z |
| 7 | GPT-6 Luna | Max | 79.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Luna (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-6-luna_max, Best score (across scorers)=0.7894736842105263, stderr=0.024191503146153773, Started at=2026-09-22T22:14:05.000Z |
| 8 | Claude Haiku 5.5 | Max | 75.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Haiku 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-haiku-5-5_max, Best score (across scorers)=0.7508771929824561, stderr=0.02566445410232946, Started at=2026-10-07T20:42:31.000Z |
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
- View all model rankings (by metric)
- Cost balance (all models, records)
- Overall ranking (all models, records)
Show rankings including legacy and unavailable models (entries: 42)
third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | Max | 95.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5.2 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-fable-5-2_max, Best score (across scorers)=0.9508771929824561, stderr=0.012824623769055387, Started at=2026-11-06T01:14:45.000Z |
| 2 | GPT-6.1 Sol | Max | 93.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-6.1-sol_max, Best score (across scorers)=0.9368421052631579, stderr=0.014434038295343787, Started at=2026-09-29T22:00:34.000Z |
| 2 | GPT-6 Astra | Max | 93.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Astra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-6-astra_max, Best score (across scorers)=0.9368421052631579, stderr=0.014434038295343787, Started at=2026-08-30T14:57:43.000Z |
| 4 | Claude Opus 5.5 | Max | 91.2% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-opus-5-5_max, Best score (across scorers)=0.9122807017543859, stderr=0.016786209858442095, Started at=2026-09-22T18:27:39.000Z |
| 5 | GPT-6.1 Terra | Max | 90.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Terra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-6.1-terra_max, Best score (across scorers)=0.9087719298245615, stderr=0.017085690144166794, Started at=2026-10-26T20:00:37.000Z |
| 6 | Gemini 4 Carbon | High | 90.5% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 4 Carbon (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-4-carbon_high, Best score (across scorers)=0.9052631578947369, stderr=0.017377516319276178, Started at=2026-11-02T23:17:42.000Z |
| 7 | GPT-6 Sol | Max | 89.8% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-6-sol_max, Best score (across scorers)=0.8982456140350877, stderr=0.01793969072128637, Started at=2026-09-22T19:59:24.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 16 (file line 29), id=RHjHEPHEsWZqFuMjBTeC6r, Model version=gpt-6-sol_max |
| 8 | GPT-5.6 Sol | Max | 89.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-5.6-sol_max, Best score (across scorers)=0.8912280701754386, stderr=0.018475392571140503, Started at=2026-07-09T02:45:09.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 92 (file line 122), id=VBpT2WWYKBZtUxG9Z3svGh, Model version=gpt-5.6-sol_max |
| 9 | Claude Sonnet 5.5 | Max | 88.8% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-sonnet-5-5_max, Best score (across scorers)=0.887719298245614, stderr=0.018734030360524248, Started at=2026-09-29T15:15:14.000Z |
| 10 | Claude Fable 5 | Max | 87.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-fable-5_max, Best score (across scorers)=0.8701754385964913, stderr=0.019944477920133024, Started at=2026-06-09T18:12:35.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 125 (file line 157), id=E28uZiJvrPgKtawbJpoZQ8, Model version=claude-fable-5_max |
| 11 | Gemini 4 Argon | High | 86.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 4 Argon (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-4-argon_high, Best score (across scorers)=0.8596491228070176, stderr=0.020611471958164294, Started at=2026-10-13T17:14:57.000Z |
| 11 | GPT-5.6 Terra | Max | 86.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Terra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-5.6-terra_max, Best score (across scorers)=0.8596491228070176, stderr=0.020611471958164294, Started at=2026-07-09T15:58:30.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 90 (file line 120), id=J6evjTMgHkrun8txnEvzdN, Model version=gpt-5.6-terra_max |
| 13 | GPT-5.5 | Xhigh | 85.3% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.5 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-5.5_xhigh, Best score (across scorers)=0.8526315789473684, stderr=0.021034091168852485, Started at=2026-06-11T17:47:36.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 114 (file line 144), id=5FGXKvXQwGPtcCX2PNrLR5, Model version=gpt-5.5_xhigh |
| 14 | GPT-5.6 Luna | Max | 82.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Luna (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-5.6-luna_max, Best score (across scorers)=0.8210526315789474, stderr=0.02274515950332741, Started at=2026-07-09T14:18:35.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 91 (file line 121), id=YLAk5J3Wd8EruVXee8bAQb, Model version=gpt-5.6-luna_max |
| 15 | Claude Opus 4.8 | Max | 80.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.8". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-opus-4-8_max, Best score (across scorers)=0.8, stderr=0.023735633163877067, Started at=2026-06-10T15:25:15.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 124 (file line 156), id=GVmgtgKMwEqc54f3jA7auP, Model version=claude-opus-4-8_max |
| 16 | GPT-6 Luna | Max | 79.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Luna (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-6-luna_max, Best score (across scorers)=0.7894736842105263, stderr=0.024191503146153773, Started at=2026-09-22T22:14:05.000Z |
| 17 | Kimi K3.1 Pro | Max | 78.3% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Kimi K3.1 Pro (Together, max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12. Epoch ran it via Together's inference API (Model version kimi-k3.1-pro-together).Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=kimi-k3.1-pro-together_max, Best score (across scorers)=0.7824561403508772, stderr=0.024481850763866792, Started at=2026-11-06T00:59:23.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 2 (file line 3), id=9iqojBnRuywLNkMDSVdwpJ, Model version=kimi-k3.1-pro-together_max |
| 18 | Claude Haiku 5.5 | Max | 75.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Haiku 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-haiku-5-5_max, Best score (across scorers)=0.7508771929824561, stderr=0.02566445410232946, Started at=2026-10-07T20:42:31.000Z |
| 19 | Qwen3.8-Max | Xhigh | 74.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Qwen3.8 Max (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=qwen3.8-max_xhigh, Best score (across scorers)=0.7473684210526316, stderr=0.0257841025556124, Started at=2026-08-04T19:32:51.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 82 (file line 108), id=ABT89ieSWGnGj4RYMduHiG, Model version=qwen3.8-max_xhigh |
| 20 | Kimi K3 | Max | 72.2% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Kimi K3 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=kimi-k3_max, Best score (across scorers)=0.721830985915493, stderr=0.026636607935112643, Started at=2026-07-17T01:48:42.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 88 (file lines 116-118; multi-line record), id=bcntamvGsSH6QgETdoaSph, Model version=kimi-k3_max |
| 21 | Gemini 3.7 Flash | High | 71.6% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.7 Flash (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-3.7-flash_high, Best score (across scorers)=0.7157894736842105, stderr=0.026764156649364653, Started at=2026-08-14T19:59:58.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 78 (file line 104), id=axMdgNDC8UYYLnZYLHZpF5, Model version=gemini-3.7-flash_high |
| 22 | DeepSeek-V4.1-Flash-1017 | Max | 71.2% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "DeepSeek V4.1 Flash 1017 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=deepseek-v4.1-flash-1017_max, Best score (across scorers)=0.712280701754386, stderr=0.02686277751301251, Started at=2026-10-19T22:39:00.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 5 (file line 6), id=UnaMiD4Yy8W4WzyeSRwybr, Model version=deepseek-v4.1-flash-1017_max |
| 23 | Claude Opus 4.7 | Max | 70.2% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.7 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-opus-4-7_max, Best score (across scorers)=0.7017543859649122, stderr=0.027146911721220194, Started at=2026-06-10T21:41:54.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 120 (file line 150), id=ZkNQ7GER7Mc9FSPmpUzgKH, Model version=claude-opus-4-7_max |
| 24 | GLM-5.3 | Max | 68.8% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GLM-5.3 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=glm-5.3_max, Best score (across scorers)=0.6877192982456141, stderr=0.027499133473298815, Started at=2026-08-25T14:20:20.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 76 (file line 102), id=iXvqUzwxAiA3Rg3dwnutFs, Model version=glm-5.3_max |
| 25 | Gemini 3.8 Flash | High | 68.4% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.8 Flash (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-3.8-flash_high, Best score (across scorers)=0.6842105263157895, stderr=0.027582557383453006, Started at=2026-09-02T17:15:36.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 21 (file line 34), id=Utgs6DuaQDDdi98ZWH22qL, Model version=gemini-3.8-flash_high |
| 26 | DeepSeek-V4.1-Flash | not stated | 67.4% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "DeepSeek V4.1 Flash (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12. No effort for the source effort label "max" because the official effort list has not been collected.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=deepseek-v4.1-flash_max, Best score (across scorers)=0.6736842105263158, stderr=0.027821981570324446, Started at=2026-10-08T19:02:32.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 10 (file lines 22-23; multi-line record), id=b6dXtaGSwvfRYADKYnj9Ci, Model version=deepseek-v4.1-flash_max |
| 27 | Grok 4.6 | Xhigh | 66.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Grok 4.6 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=grok-4.6_xhigh, Best score (across scorers)=0.6596491228070176, stderr=0.028116467881852295, Started at=2026-08-14T15:46:50.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 80 (file line 106), id=Zb2AKwa942D7dBTTcebAba, Model version=grok-4.6_xhigh |
| 27 | Claude Opus 4.6 | Max | 66.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.6 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=claude-opus-4-6_max, Best score (across scorers)=0.6596491228070176, stderr=0.028116467881852295, Started at=2026-06-11T00:19:44.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 119 (file line 149), id=kgJ2d6XbKj3dZutDcBYSKU, Model version=claude-opus-4-6_max |
| 29 | DeepSeek-V4-Pro-0813 | Max | 64.6% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "DeepSeek V4 Pro 0813 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=deepseek-v4-pro-0813_max, Best score (across scorers)=0.6456140350877193, stderr=0.028383475205435625, Started at=2026-08-19T13:35:48.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 77 (file line 103), id=b6yWmeFgsWeEiG9Qzs3NSf, Model version=deepseek-v4-pro-0813_max |
| 30 | Gemini 3.1 Pro Preview | not stated | 59.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.1 Pro Preview". No effort suffix in Model version. Data retrieved 2026-11-12. No effort because effort is not stated in the source.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-3.1-pro-preview, Best score (across scorers)=0.5964912280701754, stderr=0.02911181956525014, Started at=2026-06-11T23:35:57.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 110 (file line 140), id=hVifTUdQZrFEYabgCRu8Qq, Model version=gemini-3.1-pro-preview |
| 31 | Gemini 3.6 Flash | High | 59.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.6 Flash". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-3.6-flash_high, Best score (across scorers)=0.5894736842105263, stderr=0.02919063494391404, Started at=2026-08-02T00:36:45.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 86 (file line 114), id=nb9LnDeeQyvRCqsbsTANGD, Model version=gemini-3.6-flash_high |
| 32 | Mistral Large 4 | High | 58.6% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Mistral Large 4 Preview (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12. Epoch's label is Mistral Large 4 Preview (2026-10-06 version; Mistral Large 4 from 2026-10-29 has a different Model version, mistral-large-4-0-oss, and is not included here).Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=mistral-large-4-0_high, Best score (across scorers)=0.5859649122807018, stderr=0.02922773823944577, Started at=2026-10-12T21:38:35.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 8 (file lines 9-20; multi-line record), id=CAstp8hQG6Aehvtw85bMDX, Model version=mistral-large-4-0_high |
| 33 | GLM-5.3-Flash | Max | 55.8% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GLM-5.3-Flash (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=glm-5.3-flash_max, Best score (across scorers)=0.5578947368421052, stderr=0.029469977528223976, Started at=2026-08-27T13:29:52.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 75 (file lines 99-101; multi-line record), id=YC2u9wykbYQg4gdkf76j26, Model version=glm-5.3-flash_max |
| 34 | Grok 4.7 | Xhigh | 53.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Grok 4.7 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=grok-4.7_xhigh, Best score (across scorers)=0.5298245614035088, stderr=0.029616712041900365, Started at=2026-09-22T21:49:22.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 15 (file line 28), id=F4unBbW5M4VJogzCq4vGAb, Model version=grok-4.7_xhigh |
| 35 | Gemini 3 Flash Preview | not stated | 51.2% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3 Flash Preview". No effort suffix in Model version. Data retrieved 2026-11-12. No effort because effort is not stated in the source.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-3-flash-preview, Best score (across scorers)=0.512280701754386, stderr=0.02966059084324674, Started at=2026-06-11T23:44:30.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 109 (file line 139), id=EtgrDq6ei6kZe8K7QbXUe3, Model version=gemini-3-flash-preview |
| 36 | GPT-5.6 Luna | Low | 41.4% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Luna (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-5.6-luna_low, Best score (across scorers)=0.41403508771929826, stderr=0.029227738239445765, Started at=2026-08-29T11:07:20.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 35 (file line 53), id=ZryXhNUpPedPvGhbqdNBEw, Model version=gpt-5.6-luna_low |
| 37 | GPT-5.6 Luna | None | 39.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Luna (none)". effort is indicated by the suffix _none in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gpt-5.6-luna_none, Best score (across scorers)=0.39649122807017545, stderr=0.029026817016410068, Started at=2026-08-29T11:07:39.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 33 (file line 51), id=YwHKNFQjbat97wVLqachmi, Model version=gpt-5.6-luna_none |
| 38 | Gemini 3.1 Flash-Lite | High | 27.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.1 Flash-Lite". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-3.1-flash-lite_high, Best score (across scorers)=0.2771929824561403, stderr=0.026560920735701255, Started at=2026-08-30T22:34:53.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 24 (file line 37), id=MVZf59jt9uEoWG9w5W9apB, Model version=gemini-3.1-flash-lite_high |
| 39 | Gemini 3.5 Flash-Lite | High | 26.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.5 Flash-Lite". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-3.5-flash-lite_high, Best score (across scorers)=0.2596491228070175, stderr=0.02601675082238553, Started at=2026-08-02T01:20:17.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 85 (file line 113), id=8o2J9uQLKDCTiCFwYdkJRK, Model version=gemini-3.5-flash-lite_high |
| 40 | Gemini 2.5 Pro | not stated | 24.6% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "gemini-2.5-pro". No effort suffix in Model version. Data retrieved 2026-11-12. No effort because effort is not stated in the source.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-2.5-pro, Best score (across scorers)=0.24561403508771928, stderr=0.0255425481026507, Started at=2026-06-11T23:56:12.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 108 (file line 138), id=FkywQ2KS4AkLPzjSPmhHcS, Model version=gemini-2.5-pro |
| 41 | Gemini 3.1 Flash-Lite | Low | 22.5% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.1 Flash-Lite". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-3.1-flash-lite_low, Best score (across scorers)=0.22456140350877193, stderr=0.024761793289496806, Started at=2026-08-30T22:35:03.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 23 (file line 36), id=VcuyQvF8LWuYhQCx2FGDHh, Model version=gemini-3.1-flash-lite_low |
| 42 | Gemini 3.1 Flash-Lite | Minimal | 21.4% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, frontiermath_tiers_1_3_v2.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.1 Flash-Lite". effort is indicated by the suffix _minimal in Epoch's Model version. Data retrieved 2026-11-12.Source excerptfrontiermath_tiers_1_3_v2.csv: Model version=gemini-3.1-flash-lite_minimal, Best score (across scorers)=0.21403508771929824, stderr=0.02433800055326239, Started at=2026-08-28T12:55:30.000ZLocation frontiermath_tiers_1_3_v2.csv, data row 43 (file line 61), id=4gZy2dAAT2EPZDGz5puD3H, Model version=gemini-3.1-flash-lite_minimal |