OSWorld 2.0
Partial score on OSWorld 2.0.
- Category
- Computer use
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 3total
- All model rankings (records) · Ranked results: 4
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
Show rankings including legacy and unavailable models (entries: 4)
official results (Gemini 4 Argon model card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 4 Argon | not stated | 69.2% | — | Gemini 4 Argon model cardRetrieved 2026-11-12 · Vendor-reported value. Self-reported by Google (model card, as of 2026-10). thinking setting not statedSource excerptOSWorld-2.0 Offline subset, partial score | 69.2% |
official results (Gemini 3.8 Flash model card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 3.8 Flash | not stated | 59.0% | — | Gemini 3.8 Flash model cardRetrieved 2026-11-12 · Vendor-reported value. Self-reported by Google (model card, as of 2026-09). thinking setting not statedSource excerptOSWorld-2.0 (partial score, batch tool enabled) | 59.0% |
official results (Gemini 3.7 Flash model card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 3.7 Flash | not stated | 47.9% | — | Gemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. Computed in-house; partial score; maximum of 3 runs (1 trial each); up to 500 steps; run before the official 08.08 patchSource excerptOSWorld-2.0 Agentic computer use | 47.9%Location Gemini 3.7 Flash model card Evaluation table, OSWorld-2.0 row, Gemini 3.7 Flash column. In-house computation basis: methodology PDF, Computer use / OSWorld 2.0 | |
| 2 | Gemini 3.6 Flash | not stated | 33.8% | — | Gemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. Computed in-house; partial score; maximum of 3 runs (1 trial each); up to 500 steps; run before the official 08.08 patchSource excerptOSWorld-2.0 Agentic computer use | 33.8%Location Gemini 3.7 Flash model card Evaluation table, OSWorld-2.0 row, Gemini 3.6 Flash column. In-house computation basis: methodology PDF, Computer use / OSWorld 2.0 |