SWE-Atlas-QnA

QA for codebase understanding.

Category
Coding
Unit
Percent (%)
Higher is better
Comparison groups
1total
All model rankings (records) · Ranked results: 1

All model rankings (records)

These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.

Show rankings including legacy and unavailable models (entries: 1)

official results (Introducing Mistral Large 4)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Mistral Large 4not stated59.4%—Mistral AIIntroducing Mistral Large 4Retrieved 2026-11-12 · Vendor-reported value. Self-reported by Mistral (as of the 2026-10-06 preview version; a separate article says the later open weights version improved with additional RL)
Source excerptSWE-Atlas-QnA: 59.4%