SWE-Marathon (version not stated)
Long-running software engineering tasks. Kept separate from v1.1 because the version is not stated in the source or the evaluation used tasks from before the final version of v1.1.
- Category
- Agentic coding
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 1total
- All model rankings (records) · Ranked results: 1
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
Show rankings including legacy and unavailable models (entries: 1)
official results (Kimi K3 (Hugging Face model card, moonshotai))
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Kimi K3 | Max | 42.0% | — | Moonshot AI | Kimi K3 (Hugging Face model card, moonshotai)Retrieved 2026-11-13 · Vendor-reported value (self-reported by Moonshot AI). Table note: All Kimi K3 results are obtained with reasoning effort set to 'max' and temperature = 1.0. Claude Code harness. Evaluated on an official task branch adjusted for H20 before the final version of v1.1 (as of 2026-07-09).Source excerptSWE-Marathon | 42.0Location HF model card "3. Evaluation Results" table, SWE-Marathon row, Kimi K3 (max) column (leftmost numeric column). Supporting footnote: Coding / SWE-Marathon |