OSWorld 2.1 (offline set, partial)

Partial score on the OSWorld 2.1 offline set (82 tasks).

Category
Computer use
Unit
Percent (%)
Higher is better
Comparison groups
1total
Currently available model rankings · Ranked results: 3
All models (records): Groups: 2 · Entries: 7

Rankings

Values with different source types (official, third-party, paper) or measurement conditions cannot be compared, so rankings are separated by comparison group (the same source, or sources verified to use the same conditions).

Rankings include only models currently available in Claude Code / Codex, excluding legacy models.

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Fable 5.2not stated89.3%—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted.
Source excerpt89.3%Location Table, OSWorld 2.1 (offline set, partial) row: 89.3
2Claude Opus 5.5not stated87.2%—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted.
Source excerpt87.2%Location Table, OSWorld 2.1 (offline set, partial) row: 87.2
3GPT-6 Astranot stated79.5%—not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted. Values for other vendor models (as listed by Anthropic).
Source excerpt79.5%Location Table, OSWorld 2.1 (offline set, partial) row: 79.5

All model rankings (records)

These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.

Show rankings including legacy and unavailable models (entries: 7)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Fable 5.2not stated89.3%—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted.
Source excerpt89.3%Location Table, OSWorld 2.1 (offline set, partial) row: 89.3
2Claude Opus 5.5not stated87.2%—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted.
Source excerpt87.2%Location Table, OSWorld 2.1 (offline set, partial) row: 87.2
3Claude Fable 5.1not stated83.5%—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted.
Source excerpt83.5%Location Table, OSWorld 2.1 (offline set, partial) row: 83.5
4Gemini 4 Carbonnot stated81.5%—not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted. Values for other vendor models (as listed by Anthropic).
Source excerpt81.5%Location Table, OSWorld 2.1 (offline set, partial) row: 81.5
5GPT-6 Astranot stated79.5%—not statedIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted. Values for other vendor models (as listed by Anthropic).
Source excerpt79.5%Location Table, OSWorld 2.1 (offline set, partial) row: 79.5

official results (Gemini 4 Carbon (Google DeepMind models page, benchmark table))

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Gemini 4 CarbonHigh81.5%—GoogleGemini 4 Carbon (Google DeepMind models page, benchmark table)Retrieved 2026-11-12 · Vendor-reported value. Google published table. methodology PDF: Gemini 4 Carbon/Argon used the highest Gemini API thinking setting, pass@1, and a single trial. Row-specific source: self-measured. 82-task offline subset, maximum of 3 runs, partial score
Source excerptOSWorld-2.1 (offline subset): Gemini 4 Carbon 81.5
2Gemini 4 ArgonHigh74.7%—GoogleGemini 4 Carbon (Google DeepMind models page, benchmark table)Retrieved 2026-11-12 · Vendor-reported value. Google published table. methodology PDF: Gemini 4 Carbon/Argon used the highest Gemini API thinking setting, pass@1, and a single trial. Row-specific source: self-measured. 82-task offline subset, maximum of 3 runs, partial score
Source excerptOSWorld-2.1 (offline subset): Gemini 4 Argon 74.7