Chess Puzzles(Epoch AI)
Chess tactics problems (run by Epoch AI).
- Category
- Reasoning
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 1total
- Currently available model rankings · Ranked results: 8
- All models (records): Groups: 1 · Entries: 62
Rankings
Values with different source types (official, third-party, paper) or measurement conditions cannot be compared, so rankings are separated by comparison group (the same source, or sources verified to use the same conditions).
Rankings include only models currently available in Claude Code / Codex, excluding legacy models.
- View on rankings page (by metric)
- Cost balance (frontier and effort changes)
- Overall ranking (performance first)
third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | Max | 79.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5.2 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-fable-5-2_max, Best score (across scorers)=0.79, stderr=0.040936018074033236, Started at=2026-11-06T01:14:45.000Z |
| 2 | GPT-6 Astra | Max | 74.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Astra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-6-astra_max, Best score (across scorers)=0.74, stderr=0.0440844002276808, Started at=2026-10-13T13:42:38.000Z |
| 3 | GPT-6.1 Sol | Max | 68.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-6.1-sol_max, Best score (across scorers)=0.68, stderr=0.04688261722621507, Started at=2026-10-13T12:40:12.000Z |
| 4 | Claude Opus 5.5 | Max | 67.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-opus-5-5_max, Best score (across scorers)=0.67, stderr=0.04725815626252609, Started at=2026-10-13T13:01:31.000Z |
| 5 | Claude Sonnet 5.5 | Max | 59.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-sonnet-5-5_max, Best score (across scorers)=0.59, stderr=0.04943110704237103, Started at=2026-10-13T13:00:38.000Z |
| 6 | Claude Haiku 5.5 | Max | 55.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Haiku 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-haiku-5-5_max, Best score (across scorers)=0.55, stderr=0.049999999999999996, Started at=2026-10-13T12:40:01.000Z |
| 7 | GPT-6 Luna | Max | 36.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Luna (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-6-luna_max, Best score (across scorers)=0.36, stderr=0.04824181513244218, Started at=2026-10-13T13:37:06.000Z |
| 8 | Claude Haiku 5.5 | Low | 24.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Haiku 5.5 (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-haiku-5-5_low, Best score (across scorers)=0.24, stderr=0.04292346959909278, Started at=2026-10-13T07:50:03.000Z |
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
- View all model rankings (by metric)
- Cost balance (all models, records)
- Overall ranking (all models, records)
Show rankings including legacy and unavailable models (entries: 62)
third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | Max | 79.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5.2 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-fable-5-2_max, Best score (across scorers)=0.79, stderr=0.040936018074033236, Started at=2026-11-06T01:14:45.000Z |
| 2 | Gemini 4 Carbon | High | 78.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 4 Carbon (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-4-carbon_high, Best score (across scorers)=0.78, stderr=0.04163331998932266, Started at=2026-11-02T23:17:42.000Z |
| 3 | GPT-6 Astra | Max | 74.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Astra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-6-astra_max, Best score (across scorers)=0.74, stderr=0.0440844002276808, Started at=2026-10-13T13:42:38.000Z |
| 4 | GPT-6.1 Sol | Max | 68.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-6.1-sol_max, Best score (across scorers)=0.68, stderr=0.04688261722621507, Started at=2026-10-13T12:40:12.000Z |
| 5 | Claude Opus 5.5 | Max | 67.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-opus-5-5_max, Best score (across scorers)=0.67, stderr=0.04725815626252609, Started at=2026-10-13T13:01:31.000Z |
| 6 | Gemini 3.7 Flash | High | 66.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.7 Flash (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3.7-flash_high, Best score (across scorers)=0.66, stderr=0.04760952285695234, Started at=2026-10-13T13:00:23.000ZLocation chess_puzzles.csv, data row 154 (file line 210), id=Xu34dKTAdpBWL6advf6DMg, Model version=gemini-3.7-flash_high |
| 7 | GPT-5.5 | Xhigh | 63.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.5 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.5_xhigh, Best score (across scorers)=0.63, stderr=0.048523658709390974, Started at=2026-10-13T13:54:48.000ZLocation chess_puzzles.csv, data row 78 (file line 129), id=DFWQcrbMegFAcEWZKWoJxC, Model version=gpt-5.5_xhigh |
| 8 | Gemini 4 Argon | High | 59.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 4 Argon (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-4-argon_high, Best score (across scorers)=0.59, stderr=0.04943110704237103, Started at=2026-10-13T17:15:18.000Z |
| 8 | Claude Sonnet 5.5 | Max | 59.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-sonnet-5-5_max, Best score (across scorers)=0.59, stderr=0.04943110704237103, Started at=2026-10-13T13:00:38.000Z |
| 8 | GPT-5.6 Sol | Max | 59.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.6-sol_max, Best score (across scorers)=0.59, stderr=0.049431107042371025, Started at=2026-10-13T13:50:12.000ZLocation chess_puzzles.csv, data row 88 (file line 139), id=oWqwMmwEd7LU3eU5Ftak64, Model version=gpt-5.6-sol_max |
| 11 | Gemini 3.8 Flash | High | 58.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.8 Flash (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3.8-flash_high, Best score (across scorers)=0.58, stderr=0.04960449637488583, Started at=2026-10-13T12:39:05.000ZLocation chess_puzzles.csv, data row 163 (file line 220), id=Hpyy6CpmXmd5q7Zbdq63CR, Model version=gemini-3.8-flash_high |
| 12 | GPT-6 Sol | Max | 56.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-6-sol_max, Best score (across scorers)=0.56, stderr=0.049888765156985884, Started at=2026-10-13T13:41:42.000ZLocation chess_puzzles.csv, data row 105 (file line 159), id=N9uFn7EZFsvHNcHEwEy3J6, Model version=gpt-6-sol_max |
| 13 | Claude Haiku 5.5 | Max | 55.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Haiku 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-haiku-5-5_max, Best score (across scorers)=0.55, stderr=0.049999999999999996, Started at=2026-10-13T12:40:01.000Z |
| 14 | Claude Opus 4.8 | Max | 52.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.8". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-opus-4-8_max, Best score (across scorers)=0.52, stderr=0.05021167315686782, Started at=2026-10-13T13:35:27.000ZLocation chess_puzzles.csv, data row 117 (file line 171), id=PEZpuEuU65bu3ZtvjLytHq, Model version=claude-opus-4-8_max |
| 15 | Gemini 3.1 Pro Preview | High | 51.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.1 Pro Preview". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3.1-pro-preview_high, Best score (across scorers)=0.51, stderr=0.05024183937956913, Started at=2026-10-13T13:34:13.000ZLocation chess_puzzles.csv, data row 123 (file line 177), id=FTDFCpXzDTgfgWBNdHLHGc, Model version=gemini-3.1-pro-preview_high |
| 16 | DeepSeek-V4.1-Flash | not stated | 48.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "DeepSeek V4.1 Flash (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12. No effort for the source effort label "max" because the official effort list has not been collected.Source excerptchess_puzzles.csv: Model version=deepseek-v4.1-flash_max, Best score (across scorers)=0.48, stderr=0.05021167315686782, Started at=2026-10-13T12:39:44.000ZLocation chess_puzzles.csv, data row 160 (file lines 216-217; multi-line record), id=ACpDTbhRPwce2BWQTWD8iC, Model version=deepseek-v4.1-flash_max |
| 17 | GPT-5.6 Terra | Max | 47.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Terra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.6-terra_max, Best score (across scorers)=0.47, stderr=0.05016135580465918, Started at=2026-10-13T13:53:13.000ZLocation chess_puzzles.csv, data row 85 (file line 136), id=J2ZgtxyaQZfyDMPTPxS8nm, Model version=gpt-5.6-terra_max |
| 17 | Claude Fable 5 | Max | 47.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-fable-5_max, Best score (across scorers)=0.47, stderr=0.05016135580465918, Started at=2026-10-13T13:34:37.000ZLocation chess_puzzles.csv, data row 121 (file line 175), id=bxS76CJuVws8iwWU2Wr2PM, Model version=claude-fable-5_max |
| 19 | Qwen3.8-Max | Xhigh | 46.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Qwen3.8 Max (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=qwen3.8-max_xhigh, Best score (across scorers)=0.46, stderr=0.05009082659620331, Started at=2026-10-13T13:13:49.000ZLocation chess_puzzles.csv, data row 143 (file line 199), id=bq5y6Tp83KLtxC58UDfpyN, Model version=qwen3.8-max_xhigh |
| 19 | DeepSeek-V4.1-Flash-1017 | Max | 46.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "DeepSeek V4.1 Flash 1017 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=deepseek-v4.1-flash-1017_max, Best score (across scorers)=0.46, stderr=0.05009082659620331, Started at=2026-10-19T22:39:00.000ZLocation chess_puzzles.csv, data row 11 (file line 23), id=4sRo7TxavQAsjaEALPZdDy, Model version=deepseek-v4.1-flash-1017_max |
| 19 | DeepSeek-V4-Pro-0813 | Max | 46.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "DeepSeek V4 Pro 0813 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=deepseek-v4-pro-0813_max, Best score (across scorers)=0.46, stderr=0.05009082659620331, Started at=2026-10-13T13:13:34.000ZLocation chess_puzzles.csv, data row 144 (file line 200), id=C56VHYLMeww2wXebeJh3gg, Model version=deepseek-v4-pro-0813_max |
| 22 | Kimi K3.1 Pro | Max | 45.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Kimi K3.1 Pro (Together, max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12. Epoch ran it via Together's inference API (Model version kimi-k3.1-pro-together).Source excerptchess_puzzles.csv: Model version=kimi-k3.1-pro-together_max, Best score (across scorers)=0.45, stderr=0.05, Started at=2026-11-06T00:59:23.000ZLocation chess_puzzles.csv, data row 2 (file line 3), id=8eSYUWwajdBjKiiM9CwnKu, Model version=kimi-k3.1-pro-together_max |
| 22 | Claude Fable 5 | High | 45.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5 (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-fable-5_high, Best score (across scorers)=0.45, stderr=0.05, Started at=2026-10-13T13:24:08.000ZLocation chess_puzzles.csv, data row 133 (file line 189), id=9ZFhnyMNCKZ8XdR58WGD3D, Model version=claude-fable-5_high |
| 24 | GPT-5.6 Luna | Max | 43.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Luna (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.6-luna_max, Best score (across scorers)=0.43, stderr=0.0497569851956243, Started at=2026-10-13T13:53:45.000ZLocation chess_puzzles.csv, data row 82 (file line 133), id=LUfGWqWQim7rdBPgSpbrXS, Model version=gpt-5.6-luna_max |
| 25 | Gemini 3.6 Flash | Low | 42.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.6 Flash". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3.6-flash_low, Best score (across scorers)=0.42, stderr=0.04960449637488583, Started at=2026-10-13T13:12:52.000ZLocation chess_puzzles.csv, data row 148 (file line 204), id=hJ6XXLBm9yfXtSbbhWuwpw, Model version=gemini-3.6-flash_low |
| 26 | Claude Opus 4.7 | Max | 41.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.7 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-opus-4-7_max, Best score (across scorers)=0.41, stderr=0.04943110704237103, Started at=2026-10-13T13:36:23.000ZLocation chess_puzzles.csv, data row 114 (file line 168), id=XXPqVNR7WCFFA2Rnzjcbk6, Model version=claude-opus-4-7_max |
| 26 | Grok 4.7 | Xhigh | 41.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Grok 4.7 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=grok-4.7_xhigh, Best score (across scorers)=0.41, stderr=0.04943110704237103, Started at=2026-10-13T12:39:21.000ZLocation chess_puzzles.csv, data row 162 (file line 219), id=L5Ck7pMy8bVmVMMLwxJN7f, Model version=grok-4.7_xhigh |
| 28 | Gemini 3 Flash Preview | High | 40.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3 Flash Preview". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3-flash-preview_high, Best score (across scorers)=0.4, stderr=0.0492365963917331, Started at=2026-10-13T13:42:10.000ZLocation chess_puzzles.csv, data row 104 (file line 158), id=UUNZJtgib9XbCjLEdhtGaT, Model version=gemini-3-flash-preview_high |
| 28 | Gemini 3.6 Flash | High | 40.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.6 Flash". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3.6-flash_high, Best score (across scorers)=0.4, stderr=0.0492365963917331, Started at=2026-10-13T13:14:52.000ZLocation chess_puzzles.csv, data row 140 (file line 196), id=ZDeGG5QYkdgVqzGPmmnbfx, Model version=gemini-3.6-flash_high |
| 30 | GLM-5.3 | Max | 37.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GLM-5.3 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=glm-5.3_max, Best score (across scorers)=0.37, stderr=0.048523658709390974, Started at=2026-10-13T21:22:18.000ZLocation chess_puzzles.csv, data row 26 (file line 56), id=kG3hbd8qLEd6fLAJHyQTiN, Model version=glm-5.3_max |
| 30 | Kimi K3 | High | 37.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Kimi K3 (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=kimi-k3_high, Best score (across scorers)=0.37, stderr=0.048523658709390974, Started at=2026-10-13T17:10:13.000ZLocation chess_puzzles.csv, data row 31 (file lines 63-65; multi-line record), id=X2QNPHFXuWosA6AiuvVtDv, Model version=kimi-k3_high |
| 32 | GPT-6 Luna | Max | 36.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Luna (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-6-luna_max, Best score (across scorers)=0.36, stderr=0.04824181513244218, Started at=2026-10-13T13:37:06.000Z |
| 32 | Claude Opus 4.7 | Xhigh | 36.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.7 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-opus-4-7_xhigh, Best score (across scorers)=0.36, stderr=0.04824181513244218, Started at=2026-10-13T13:35:58.000ZLocation chess_puzzles.csv, data row 115 (file line 169), id=RHbNnWqK6x8f6pR2AZ8VAq, Model version=claude-opus-4-7_xhigh |
| 32 | Kimi K3 | Max | 36.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Kimi K3 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=kimi-k3_max, Best score (across scorers)=0.36, stderr=0.048241815132442176, Started at=2026-10-13T17:13:35.000ZLocation chess_puzzles.csv, data row 30 (file lines 60-62; multi-line record), id=nzQV9YvictnDF2EwxqTJQs, Model version=kimi-k3_max |
| 35 | Mistral Large 4 | High | 33.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Mistral Large 4 Preview (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12. Epoch's label is Mistral Large 4 Preview (2026-10-06 version; Mistral Large 4 from 2026-10-29 has a different Model version, mistral-large-4-0-oss, and is not included here).Source excerptchess_puzzles.csv: Model version=mistral-large-4-0_high, Best score (across scorers)=0.33, stderr=0.04725815626252608, Started at=2026-10-15T22:52:59.000ZLocation chess_puzzles.csv, data row 12 (file lines 24-35; multi-line record), id=eNdDCt2u6A8mPisK56SApU, Model version=mistral-large-4-0_high |
| 35 | Grok 4.6 | Xhigh | 33.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Grok 4.6 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=grok-4.6_xhigh, Best score (across scorers)=0.33, stderr=0.04725815626252608, Started at=2026-10-13T13:14:03.000ZLocation chess_puzzles.csv, data row 142 (file line 198), id=NiuExVccWkWbWqi6ex6vvf, Model version=grok-4.6_xhigh |
| 35 | Grok 4.6 | High | 33.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Grok 4.6 (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=grok-4.6_high, Best score (across scorers)=0.33, stderr=0.04725815626252608, Started at=2026-10-13T13:00:07.000ZLocation chess_puzzles.csv, data row 156 (file line 212), id=YoAJyC3j8dZ6ZpDZ5rSDLw, Model version=grok-4.6_high |
| 38 | GPT-5.6 Sol | Low | 31.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Sol (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.6-sol_low, Best score (across scorers)=0.31, stderr=0.04648231987117317, Started at=2026-10-13T13:49:48.000ZLocation chess_puzzles.csv, data row 89 (file line 140), id=V6aVGtn9gAmRep2oBGsqVN, Model version=gpt-5.6-sol_low |
| 38 | Claude Fable 5 | Low | 31.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5 (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-fable-5_low, Best score (across scorers)=0.31, stderr=0.04648231987117317, Started at=2026-10-13T13:23:41.000ZLocation chess_puzzles.csv, data row 134 (file line 190), id=2jKf4iEfVQnHkgAwEtD9Nn, Model version=claude-fable-5_low |
| 40 | GPT-5.5 | Low | 30.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.5 (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.5_low, Best score (across scorers)=0.3, stderr=0.04605661864718382, Started at=2026-10-13T13:54:20.000ZLocation chess_puzzles.csv, data row 80 (file line 131), id=4EayGByBV2xodNBkrZMcFb, Model version=gpt-5.5_low |
| 41 | Claude Opus 4.8 | Low | 29.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.8". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-opus-4-8_low, Best score (across scorers)=0.29, stderr=0.045604802157206865, Started at=2026-10-13T13:35:16.000ZLocation chess_puzzles.csv, data row 118 (file line 172), id=icTHLT2S2egxYtgbjQHUng, Model version=claude-opus-4-8_low |
| 41 | Gemini 3.6 Flash | Minimal | 29.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.6 Flash". effort is indicated by the suffix _minimal in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3.6-flash_minimal, Best score (across scorers)=0.29, stderr=0.04560480215720686, Started at=2026-10-13T13:12:45.000ZLocation chess_puzzles.csv, data row 149 (file line 205), id=beSbPHiiWcwJBSzYRh7Kh4, Model version=gemini-3.6-flash_minimal |
| 43 | GPT-5.6 Terra | Low | 27.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Terra (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.6-terra_low, Best score (across scorers)=0.27, stderr=0.044619604333847374, Started at=2026-10-13T13:51:29.000ZLocation chess_puzzles.csv, data row 86 (file line 137), id=bA5j9K2shzZVFGTMQ5g6EU, Model version=gpt-5.6-terra_low |
| 44 | Claude Opus 4.7 | Low | 26.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.7 (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-opus-4-7_low, Best score (across scorers)=0.26, stderr=0.0440844002276808, Started at=2026-10-13T13:35:50.000ZLocation chess_puzzles.csv, data row 116 (file line 170), id=NyAvSf73nUe84HuY6Vpjkh, Model version=claude-opus-4-7_low |
| 45 | Claude Haiku 5.5 | Low | 24.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Haiku 5.5 (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-haiku-5-5_low, Best score (across scorers)=0.24, stderr=0.04292346959909278, Started at=2026-10-13T07:50:03.000Z |
| 46 | Claude Sonnet 4.6 | Max | 23.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 4.6 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-sonnet-4-6_max, Best score (across scorers)=0.23, stderr=0.04229525846816507, Started at=2026-10-13T13:44:15.000ZLocation chess_puzzles.csv, data row 95 (file line 146), id=6P9AJQmBzaPmE7ossbqLjz, Model version=claude-sonnet-4-6_max |
| 47 | Claude Opus 4.6 | Max | 21.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.6 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-opus-4-6_max, Best score (across scorers)=0.21, stderr=0.040936018074033236, Started at=2026-10-13T13:43:19.000ZLocation chess_puzzles.csv, data row 98 (file line 149), id=aKc2rzsA6YPYwCkE7nhvvB, Model version=claude-opus-4-6_max |
| 47 | Gemini 3.5 Flash-Lite | Low | 21.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.5 Flash-Lite". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3.5-flash-lite_low, Best score (across scorers)=0.21, stderr=0.040936018074033236, Started at=2026-10-13T13:25:11.000ZLocation chess_puzzles.csv, data row 132 (file line 188), id=d5QCJNq9uLtxjhiMhqXLmg, Model version=gemini-3.5-flash-lite_low |
| 47 | GLM-5.3-Flash | Max | 21.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GLM-5.3-Flash (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=glm-5.3-flash_max, Best score (across scorers)=0.21, stderr=0.040936018074033236, Started at=2026-10-13T15:54:34.000ZLocation chess_puzzles.csv, data row 33 (file lines 69-71; multi-line record), id=fWNxmiSUC7BX8whqvzssY8, Model version=glm-5.3-flash_max |
| 50 | Claude Sonnet 4.6 | High | 19.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 4.6 (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-sonnet-4-6_high, Best score (across scorers)=0.19, stderr=0.039427724440366255, Started at=2026-10-13T13:36:50.000ZLocation chess_puzzles.csv, data row 112 (file line 166), id=Atc4F5iuMZu3vNBWVGCBnv, Model version=claude-sonnet-4-6_high |
| 50 | Claude Opus 4.8 | not stated | 19.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.8". effort is indicated by the suffix _none in Epoch's Model version. Data retrieved 2026-11-12. No effort because the source effort label "none" is not in the official effort list.Source excerptchess_puzzles.csv: Model version=claude-opus-4-8_none, Best score (across scorers)=0.19, stderr=0.039427724440366255, Started at=2026-10-13T13:34:59.000ZLocation chess_puzzles.csv, data row 119 (file line 173), id=jDWEviMweCdzGxLfz8sdBm, Model version=claude-opus-4-8_none |
| 52 | Kimi K3 | Low | 18.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Kimi K3 (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=kimi-k3_low, Best score (across scorers)=0.18, stderr=0.03861229196653691, Started at=2026-10-13T17:06:54.000ZLocation chess_puzzles.csv, data row 32 (file lines 66-68; multi-line record), id=VPSX7EnwWuBrCPnpYGMUEM, Model version=kimi-k3_low |
| 53 | GPT-5.6 Luna | Low | 17.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Luna (low)". effort is indicated by the suffix _low in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.6-luna_low, Best score (across scorers)=0.17, stderr=0.03775251680686369, Started at=2026-10-13T13:53:37.000ZLocation chess_puzzles.csv, data row 83 (file line 134), id=FagAUZ7m5PJHseDATvp2vf, Model version=gpt-5.6-luna_low |
| 54 | Claude Sonnet 4.6 | Med | 16.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 4.6 (medium)". effort is indicated by the suffix _medium in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=claude-sonnet-4-6_medium, Best score (across scorers)=0.16, stderr=0.03684529491774706, Started at=2026-10-13T13:36:47.000ZLocation chess_puzzles.csv, data row 113 (file line 167), id=htvM9QKQJ8TfBxTzDxfZfp, Model version=claude-sonnet-4-6_medium |
| 54 | Gemini 3.5 Flash-Lite | High | 16.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.5 Flash-Lite". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3.5-flash-lite_high, Best score (across scorers)=0.16, stderr=0.036845294917747066, Started at=2026-10-13T13:26:52.000ZLocation chess_puzzles.csv, data row 131 (file line 187), id=JJyzHWKJUA3iTZDU8iYefz, Model version=gemini-3.5-flash-lite_high |
| 56 | GPT-5.5 | None | 9.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.5 (no thinking)". effort is indicated by the suffix _none in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.5_none, Best score (across scorers)=0.09, stderr=0.028762349126466143, Started at=2026-10-13T13:53:55.000ZLocation chess_puzzles.csv, data row 81 (file line 132), id=QfS2PrjUFMNnceRZmCmewP, Model version=gpt-5.5_none |
| 57 | GPT-5.6 Sol | None | 7.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Sol (none)". effort is indicated by the suffix _none in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.6-sol_none, Best score (across scorers)=0.07, stderr=0.02564323999762428, Started at=2026-10-13T13:49:41.000ZLocation chess_puzzles.csv, data row 90 (file line 141), id=WvV6QREDDXeDEGdrKztDsy, Model version=gpt-5.6-sol_none |
| 57 | Gemini 3.5 Flash-Lite | Minimal | 7.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.5 Flash-Lite". effort is indicated by the suffix _minimal in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gemini-3.5-flash-lite_minimal, Best score (across scorers)=0.07, stderr=0.02564323999762428, Started at=2026-10-13T13:19:48.000ZLocation chess_puzzles.csv, data row 138 (file line 194), id=gzQH7StUXaxAtXgxkTgyxJ, Model version=gemini-3.5-flash-lite_minimal |
| 59 | Claude Sonnet 4.5 | not stated | 6.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 4.5 (no thinking)". No effort suffix in Model version. Data retrieved 2026-11-12. No effort because effort is not stated in the source.Source excerptchess_puzzles.csv: Model version=claude-sonnet-4-5-20250929, Best score (across scorers)=0.06, stderr=0.023868325657594204, Started at=2026-10-13T13:43:54.000ZLocation chess_puzzles.csv, data row 96 (file line 147), id=VajBDnUCyX7uqAfMTbi63j, Model version=claude-sonnet-4-5-20250929 |
| 60 | GPT-5.6 Terra | None | 5.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Terra (none)". effort is indicated by the suffix _none in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.6-terra_none, Best score (across scorers)=0.05, stderr=0.02190429135575903, Started at=2026-10-13T13:50:17.000ZLocation chess_puzzles.csv, data row 87 (file line 138), id=HzNnNaRmyNExSVaMjmFCHe, Model version=gpt-5.6-terra_none |
| 60 | Claude Opus 4.5 | not stated | 5.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.5 (no thinking)". No effort suffix in Model version. Data retrieved 2026-11-12. No effort because effort is not stated in the source.Source excerptchess_puzzles.csv: Model version=claude-opus-4-5-20251101, Best score (across scorers)=0.05, stderr=0.021904291355759033, Started at=2026-10-13T13:42:24.000ZLocation chess_puzzles.csv, data row 103 (file line 157), id=4afZ2hjLiJnPy5pD7TfE3K, Model version=claude-opus-4-5-20251101 |
| 62 | GPT-5.6 Luna | None | 3.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, chess_puzzles.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Luna (none)". effort is indicated by the suffix _none in Epoch's Model version. Data retrieved 2026-11-12.Source excerptchess_puzzles.csv: Model version=gpt-5.6-luna_none, Best score (across scorers)=0.03, stderr=0.01714466079977653, Started at=2026-10-13T13:53:29.000ZLocation chess_puzzles.csv, data row 84 (file line 135), id=5Q7zWYmoRik8mhABL4wpVR, Model version=gpt-5.6-luna_none |