HLE-Verified
Verified subset of Humanity's Last Exam.
- Category
- Reasoning
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 2total
- All model rankings (records) · Ranked results: 3
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
Show rankings including legacy and unavailable models (entries: 3)
official results (Gemini 3.8 Flash model card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 3.8 Flash | not stated | 54.9% | — | Gemini 3.8 Flash model cardRetrieved 2026-11-12 · Vendor-reported value. Self-reported by Google (model card, as of 2026-09). thinking setting not statedSource excerptHLE-Verified | 54.9% |
official results (Gemini 3.7 Flash model card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 3.7 Flash | not stated | 53.6% | — | Gemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. All models computed in-house; 1,811 verified questionsSource excerptHLE-Verified Multidisciplinary expert reasoning | 53.6%Location Gemini 3.7 Flash model card Evaluation table, HLE-Verified row, Gemini 3.7 Flash column. In-house computation basis: methodology PDF, Scientific Reasoning / HLE-Verified | |
| 2 | Gemini 3.6 Flash | not stated | 51.2% | — | Gemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. All models computed in-house; 1,811 verified questionsSource excerptHLE-Verified Multidisciplinary expert reasoning | 51.2%Location Gemini 3.7 Flash model card Evaluation table, HLE-Verified row, Gemini 3.6 Flash column. In-house computation basis: methodology PDF, Scientific Reasoning / HLE-Verified |