BioMysteryBench(Human Difficult)

Biology mystery tasks (group difficult even for humans).

Category
Knowledge
Unit
Percent (%)
Higher is better
Comparison groups
2total
All model rankings (records) · Ranked results: 3

All model rankings (records)

These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.

Show rankings including legacy and unavailable models (entries: 3)

official results (Gemini 3.8 Flash model card)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Gemini 3.8 Flashnot stated56.5%—GoogleGemini 3.8 Flash model cardRetrieved 2026-11-12 · Vendor-reported value. Self-reported by Google (model card, as of 2026-09). thinking setting not stated
Source excerptBioMysteryBench, Human Difficult | 56.5%

official results (Gemini 3.7 Flash model card)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Gemini 3.7 Flashnot stated43.5%—GoogleGemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. Gemini computed in-house
Source excerptHuman difficult | 43.5%Location Gemini 3.7 Flash model card Evaluation table, BioMysteryBench(Human difficult) row, Gemini 3.7 Flash column. In-house computation basis: methodology PDF, Scientific Reasoning / BioMysteryBench
2Gemini 3.6 Flashnot stated41.2%—GoogleGemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. Gemini computed in-house
Source excerptHuman difficult | 41.2%Location Gemini 3.7 Flash model card Evaluation table, BioMysteryBench(Human difficult) row, Gemini 3.6 Flash column. In-house computation basis: methodology PDF, Scientific Reasoning / BioMysteryBench