Agents' Last Exam v1.1(rubric score)
Long-running practical tasks for agents (v1.1, 122 tasks, averaged rubric score).
- Category
- Computer use
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 1total
- All model rankings (records) · Ranked results: 2
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
Show rankings including legacy and unavailable models (entries: 2)
official results (Gemini 4 Carbon (Google DeepMind models page, benchmark table))
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 4 Carbon | High | 77.4% | — | Gemini 4 Carbon (Google DeepMind models page, benchmark table)Retrieved 2026-11-12 · Vendor-reported value. Google published table. methodology PDF: Gemini 4 Carbon/Argon used the highest Gemini API thinking setting, pass@1, and a single trial. Row-specific source: self-measured. 122 tasks, ALE-Claw harness, 5-hour window, averaged rubric ScoreSource excerptAgents' Last Exam v1.1: Gemini 4 Carbon 77.4 | |
| 2 | Gemini 4 Argon | High | 69.0% | — | Gemini 4 Carbon (Google DeepMind models page, benchmark table)Retrieved 2026-11-12 · Vendor-reported value. Google published table. methodology PDF: Gemini 4 Carbon/Argon used the highest Gemini API thinking setting, pass@1, and a single trial. Row-specific source: self-measured. 122 tasks, ALE-Claw harness, 5-hour window, averaged rubric ScoreSource excerptAgents' Last Exam v1.1: Gemini 4 Argon 69.0 |