Vending-Bench 2

Vending machine management simulation. The score is the final balance (USD).

Category
Other
Unit
Score
Higher is better
Comparison groups
1total
All model rankings (records) · Ranked results: 2

All model rankings (records)

These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.

Show rankings including legacy and unavailable models (entries: 2)

official results (Gemini 4 Carbon (Google DeepMind models page, benchmark table))

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Gemini 4 CarbonHigh16,484—Andon LabsGemini 4 Carbon (Google DeepMind models page, benchmark table)Retrieved 2026-11-12 · Vendor-reported value. Google published table. methodology PDF: Gemini 4 Carbon/Argon used the highest Gemini API thinking setting, pass@1, and a single trial. Row-specific source: Andon Labs official leaderboard (final balance $)
Source excerptVending-Bench 2: Gemini 4 Carbon 16484
2Gemini 4 ArgonHigh13,718—Andon LabsGemini 4 Carbon (Google DeepMind models page, benchmark table)Retrieved 2026-11-12 · Vendor-reported value. Google published table. methodology PDF: Gemini 4 Carbon/Argon used the highest Gemini API thinking setting, pass@1, and a single trial. Row-specific source: Andon Labs official leaderboard (final balance $)
Source excerptVending-Bench 2: Gemini 4 Argon 13718