MirrorCode
Coding tasks run by Epoch AI.
- Category
- Coding
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 1total
- Currently available model rankings · Ranked results: 9
- All models (records): Groups: 1 · Entries: 32
Rankings
Values with different source types (official, third-party, paper) or measurement conditions cannot be compared, so rankings are separated by comparison group (the same source, or sources verified to use the same conditions).
Rankings include only models currently available in Claude Code / Codex, excluding legacy models.
- View on rankings page (by metric)
- Cost balance (frontier and effort changes)
- Overall ranking (performance first)
third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Sonnet 5.5 | Max | 97.8% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-sonnet-5-5_max, Best score (across scorers)=0.9777777777777777, stderr=0.015141892085983264, Started at=2026-10-05T09:05:15.000Z |
| 2 | Claude Opus 5.5 | Max | 95.6% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-opus-5-5_max, Best score (across scorers)=0.9555555555555556, stderr=0.025545201491160446, Started at=2026-10-30T18:25:28.000Z |
| 3 | Claude Haiku 5.5 | Max | 78.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Haiku 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-haiku-5-5_max, Best score (across scorers)=0.7888888888888889, stderr=0.08045286284110595, Started at=2026-10-21T16:48:32.000Z |
| 3 | Claude Opus 5.5 | High | 78.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 5.5 (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-opus-5-5_high, Best score (across scorers)=0.7889, stderr=0.0788, Started at=2026-09-22T16:42:00.000Z |
| 5 | GPT-6.1 Terra | Max | 76.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Terra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6.1-terra_max, Best score (across scorers)=0.7666666666666667, stderr=0.09315175080076958, Started at=2026-10-30T11:34:52.000Z |
| 6 | GPT-6.1 Sol | Max | 61.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6.1-sol_max, Best score (across scorers)=0.6111111111111112, stderr=0.11346708571848581, Started at=2026-10-05T18:36:30.000Z |
| 7 | GPT-6 Astra | Max | 60.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Astra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6-astra_max, Best score (across scorers)=0.6, stderr=0.11818736805705578, Started at=2026-10-29T18:04:06.000Z |
| 8 | GPT-6 Astra | High | 46.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Astra (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6-astra_high, Best score (across scorers)=0.467, stderr=0.1186, Started at=2026-08-30T16:51:09.000Z |
| 9 | GPT-6 Luna | Max | 26.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Luna (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6-luna_max, Best score (across scorers)=0.26666666666666666, stderr=0.09026709338484401, Started at=2026-10-21T16:48:12.000Z |
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
- View all model rankings (by metric)
- Cost balance (all models, records)
- Overall ranking (all models, records)
Show rankings including legacy and unavailable models (entries: 32)
third-party results (Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Sonnet 5.5 | Max | 97.8% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Sonnet 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-sonnet-5-5_max, Best score (across scorers)=0.9777777777777777, stderr=0.015141892085983264, Started at=2026-10-05T09:05:15.000Z |
| 2 | Claude Opus 5.5 | Max | 95.6% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-opus-5-5_max, Best score (across scorers)=0.9555555555555556, stderr=0.025545201491160446, Started at=2026-10-30T18:25:28.000Z |
| 3 | Claude Haiku 5.5 | Max | 78.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Haiku 5.5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-haiku-5-5_max, Best score (across scorers)=0.7888888888888889, stderr=0.08045286284110595, Started at=2026-10-21T16:48:32.000Z |
| 3 | Claude Opus 5.5 | High | 78.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 5.5 (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-opus-5-5_high, Best score (across scorers)=0.7889, stderr=0.0788, Started at=2026-09-22T16:42:00.000Z |
| 5 | GPT-6.1 Terra | Max | 76.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Terra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6.1-terra_max, Best score (across scorers)=0.7666666666666667, stderr=0.09315175080076958, Started at=2026-10-30T11:34:52.000Z |
| 6 | Claude Fable 5 | Max | 70.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-fable-5_max, Best score (across scorers)=0.7, stderr=0.10440053112638316, Started at=2026-10-30T18:27:32.000ZLocation mirrorcode.csv, data row 1 (file line 2), id=5z3kmMLG4o5sSC6R7Ny4BS, Model version=claude-fable-5_max |
| 7 | Claude Opus 4.8 | Max | 65.6% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.8". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-opus-4-8_max, Best score (across scorers)=0.6555555555555556, stderr=0.10846044638639055, Started at=2026-10-21T16:46:28.000ZLocation mirrorcode.csv, data row 25 (file line 43), id=2Nf4PQvFjvbixGhtQXGQoS, Model version=claude-opus-4-8_max |
| 8 | DeepSeek-V4.1-Flash | not stated | 64.4% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "DeepSeek V4.1 Flash (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12. No effort for the source effort label "max" because the official effort list has not been collected.Source excerptmirrorcode.csv: Model version=deepseek-v4.1-flash_max, Best score (across scorers)=0.6444444444444445, stderr=0.11369999821616648, Started at=2026-10-21T16:49:36.000ZLocation mirrorcode.csv, data row 11 (file lines 15-16; multi-line record), id=nRrYnwt7v5xuS4K29sTubp, Model version=deepseek-v4.1-flash_max |
| 9 | Claude Fable 5 | High | 63.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Fable 5 (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-fable-5_high, Best score (across scorers)=0.638888888888889, stderr=0.10404092940368063, Started at=2026-08-10T16:12:44.227ZLocation mirrorcode.csv, data row 45 (file line 68), id=mirrorcode-ml-2l-claude-fable-5, Model version=claude-fable-5_high |
| 10 | GPT-6.1 Sol | Max | 61.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6.1 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6.1-sol_max, Best score (across scorers)=0.6111111111111112, stderr=0.11346708571848581, Started at=2026-10-05T18:36:30.000Z |
| 11 | GPT-6 Astra | Max | 60.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Astra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6-astra_max, Best score (across scorers)=0.6, stderr=0.11818736805705578, Started at=2026-10-29T18:04:06.000Z |
| 12 | Gemini 4 Argon | High | 58.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 4 Argon (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gemini-4-argon_high, Best score (across scorers)=0.5888888888888889, stderr=0.1171381252539371, Started at=2026-10-14T10:00:34.000Z |
| 13 | Grok 4.7 | Xhigh | 54.4% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Grok 4.7 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=grok-4.7_xhigh, Best score (across scorers)=0.5444444444444444, stderr=0.11439589045541113, Started at=2026-10-29T18:04:16.000ZLocation mirrorcode.csv, data row 5 (file line 6), id=2CP56MmAkTeFXXT8pSGre4, Model version=grok-4.7_xhigh |
| 13 | Kimi K3 | Max | 54.4% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Kimi K3 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=kimi-k3_max, Best score (across scorers)=0.5444444444444444, stderr=0.11439589045541113, Started at=2026-09-03T21:02:17.000ZLocation mirrorcode.csv, data row 37 (file lines 55-57; multi-line record), id=beEmcaWF8wxsWTLD5bMYxi, Model version=kimi-k3_max |
| 15 | Qwen3.8-Max | Xhigh | 52.2% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Qwen3.8 Max (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=qwen3.8-max_xhigh, Best score (across scorers)=0.5222222222222223, stderr=0.10894718232315695, Started at=2026-10-21T16:48:06.000ZLocation mirrorcode.csv, data row 24 (file line 42), id=RQRuLNXoCHzNMEbJCcUVVD, Model version=qwen3.8-max_xhigh |
| 16 | GPT-6 Sol | Max | 48.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Sol (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6-sol_max, Best score (across scorers)=0.4888888888888889, stderr=0.11205944504585896, Started at=2026-10-29T18:04:31.000ZLocation mirrorcode.csv, data row 4 (file line 5), id=TQ4LXFJtzphWHf9brvHq5i, Model version=gpt-6-sol_max |
| 17 | GPT-6 Astra | High | 46.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Astra (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6-astra_high, Best score (across scorers)=0.467, stderr=0.1186, Started at=2026-08-30T16:51:09.000Z |
| 18 | Grok 4.6 | Xhigh | 41.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Grok 4.6 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=grok-4.6_xhigh, Best score (across scorers)=0.4111111111111111, stderr=0.1101546131612538, Started at=2026-10-21T16:48:25.000ZLocation mirrorcode.csv, data row 18 (file line 23), id=Hoz4Uioui4GNZaLD6fiAvD, Model version=grok-4.6_xhigh |
| 18 | GPT-5.6 Terra | Max | 41.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Terra (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-5.6-terra_max, Best score (across scorers)=0.4111111111111111, stderr=0.12372809695177825, Started at=2026-10-20T20:32:26.000ZLocation mirrorcode.csv, data row 27 (file line 45), id=Vubr2UGkJt5WdCCxePP6bL, Model version=gpt-5.6-terra_max |
| 18 | Gemini 3.7 Flash | High | 41.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.7 Flash (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gemini-3.7-flash_high, Best score (across scorers)=0.4111111111111111, stderr=0.12157113738962926, Started at=2026-10-21T16:49:08.000ZLocation mirrorcode.csv, data row 12 (file line 17), id=eeq6feqZLzfjfVsx4aeAWL, Model version=gemini-3.7-flash_high |
| 21 | Gemini 3.8 Flash | High | 38.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.8 Flash (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gemini-3.8-flash_high, Best score (across scorers)=0.3888888888888889, stderr=0.11915339216404011, Started at=2026-09-02T17:23:38.000ZLocation mirrorcode.csv, data row 38 (file line 58), id=Fi32v8c7rD82qhgYVcsz7g, Model version=gemini-3.8-flash_high |
| 22 | Claude Opus 4.6 | Max | 33.3% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.6 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-opus-4-6_max, Best score (across scorers)=0.3333333333333333, stderr=0.10026420125303973, Started at=2026-10-21T16:48:25.000ZLocation mirrorcode.csv, data row 19 (file line 24), id=Q8sNp4aYrjtYQgVS3BRDTd, Model version=claude-opus-4-6_max |
| 22 | DeepSeek-V4-Pro-0813 | Max | 33.3% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "DeepSeek V4 Pro 0813 (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=deepseek-v4-pro-0813_max, Best score (across scorers)=0.3333333333333333, stderr=0.10026420125303973, Started at=2026-10-20T20:32:20.000ZLocation mirrorcode.csv, data row 29 (file line 47), id=4sSMLxWLPihKZSUFVUjwTh, Model version=deepseek-v4-pro-0813_max |
| 24 | Claude Opus 4.7 | High | 31.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Claude Opus 4.7 (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=claude-opus-4-7_high, Best score (across scorers)=0.3111111111111111, stderr=0.09036473223803354, Started at=2026-08-12T11:43:31.000ZLocation mirrorcode.csv, data row 40 (file line 63), id=mirrorcode-ml-2l-claude-opus-4-7, Model version=claude-opus-4-7_high |
| 25 | Mistral Large 4 | High | 27.8% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Mistral Large 4 Preview (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12. Epoch's label is Mistral Large 4 Preview (2026-10-06 version; Mistral Large 4 from 2026-10-29 has a different Model version, mistral-large-4-0-oss, and is not included here).Source excerptmirrorcode.csv: Model version=mistral-large-4-0_high, Best score (across scorers)=0.2777777777777778, stderr=0.0885907699198465, Started at=2026-10-21T16:48:20.000ZLocation mirrorcode.csv, data row 20 (file lines 25-36; multi-line record), id=5kYFmmvF8XSX6hFMwhSxB4, Model version=mistral-large-4-0_high |
| 26 | GPT-6 Luna | Max | 26.7% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-6 Luna (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-6-luna_max, Best score (across scorers)=0.26666666666666666, stderr=0.09026709338484401, Started at=2026-10-21T16:48:12.000Z |
| 27 | GPT-5.5 | Xhigh | 23.3% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.5 (xhigh)". effort is indicated by the suffix _xhigh in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-5.5_xhigh, Best score (across scorers)=0.23333333333333334, stderr=0.10131411680782823, Started at=2026-10-29T18:03:57.000ZLocation mirrorcode.csv, data row 8 (file line 12), id=Tmy5qo2ScNoA2bapbEG7HP, Model version=gpt-5.5_xhigh |
| 27 | Gemini 3.6 Flash | High | 23.3% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.6 Flash". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gemini-3.6-flash_high, Best score (across scorers)=0.23333333333333334, stderr=0.09315175080076958, Started at=2026-10-21T16:48:28.000ZLocation mirrorcode.csv, data row 17 (file line 22), id=ftpz5JnywQdGtFDCHyjMt4, Model version=gemini-3.6-flash_high |
| 29 | GPT-5.6 Luna | Max | 21.1% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Luna (max)". effort is indicated by the suffix _max in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-5.6-luna_max, Best score (across scorers)=0.2111111111111111, stderr=0.09822049844066655, Started at=2026-10-21T16:48:59.000ZLocation mirrorcode.csv, data row 14 (file line 19), id=XwpZADrRSwBo2pETMdLVRq, Model version=gpt-5.6-luna_max |
| 30 | GPT-5.6 Sol | High | 20.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.6 Sol (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-5.6-sol_high, Best score (across scorers)=0.2, stderr=0.09229582069908972, Started at=2026-08-10T16:12:44.772ZLocation mirrorcode.csv, data row 44 (file line 67), id=mirrorcode-ml-2l-gpt-5-6-sol, Model version=gpt-5.6-sol_high |
| 31 | GPT-5.5 | High | 10.0% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "GPT-5.5 (high)". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gpt-5.5_high, Best score (across scorers)=0.1, stderr=0.06042179781166438, Started at=2026-08-10T16:12:45.865ZLocation mirrorcode.csv, data row 42 (file line 65), id=mirrorcode-ml-2l-gpt-5-5, Model version=gpt-5.5_high |
| 32 | Gemini 3.1 Pro Preview | High | 8.9% | — | Epoch AI | Epoch AI, Capabilities & benchmarking (benchmark_data.zip, mirrorcode.csv) CC BY 4.0Retrieved 2026-11-12 · Run by Epoch AI (third-party measurement). Source label "Gemini 3.1 Pro Preview". effort is indicated by the suffix _high in Epoch's Model version. Data retrieved 2026-11-12.Source excerptmirrorcode.csv: Model version=gemini-3.1-pro-preview_high, Best score (across scorers)=0.08888888888888888, stderr=0.04561939004190448, Started at=2026-08-10T16:12:46.343ZLocation mirrorcode.csv, data row 41 (file line 64), id=mirrorcode-ml-2l-gemini-3-1-pro-preview, Model version=gemini-3.1-pro-preview_high |