MRCR v2 (8-needle, 128k)
Evaluation of retrieving multiple pieces of information from a long text (8-needle, average up to 128k).
- Category
- Long context
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 2total
- All model rankings (records) · Ranked results: 5
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
Show rankings including legacy and unavailable models (entries: 5)
official results (Gemini 3.7 Flash model card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 3.7 Flash | not stated | 97.0% | — | Gemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. Computed in-house; cumulative score up to 128kSource excerptGDM-MRCR v2 (8-needle) Long context performance | 128k (average) | 97.0%Location Gemini 3.7 Flash model card Evaluation table, GDM-MRCR v2 (8-needle) 128k (average) row, Gemini 3.7 Flash column. In-house computation basis: methodology PDF, Long Context / GDM-MRCR v2 | |
| 2 | Gemini 3.6 Flash | not stated | 91.8% | — | Gemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. Computed in-house; cumulative score up to 128kSource excerptGDM-MRCR v2 (8-needle) Long context performance | 128k (average) | 91.8%Location Gemini 3.7 Flash model card Evaluation table, GDM-MRCR v2 (8-needle) 128k (average) row, Gemini 3.6 Flash column. In-house computation basis: methodology PDF, Long Context / GDM-MRCR v2 |
official results (Gemini 3.5 Flash model card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 3.1 Pro Preview | not stated | 84.9% | — | Gemini 3.5 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.google/models/evals-methodology/gemini-3-5-flash): All of the results are all run with the Gemini API ... with default sampling settings unless indicated otherwise. All models computed in-house; cumulative score up to 128k. Column heading is Gemini 3.1 Pro (gemini-3.1-pro-preview is the only match in the Gemini API model list). thinking level not statedSource excerptLong context | MRCR v2 (8-needle) Long context performance | 128k (average) | 84.9%Location Gemini 3.5 Flash model card Evaluation table, MRCR v2 (8-needle) 128k (average) row, Gemini 3.1 Pro column. In-house computation basis: methodology PDF, Long Context / MRCR v2 | |
| 2 | Gemini 3.5 Flash | not stated | 77.3% | — | Gemini 3.5 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.google/models/evals-methodology/gemini-3-5-flash): All of the results are all run with the Gemini API ... with default sampling settings unless indicated otherwise. All models computed in-house; cumulative score up to 128k. thinking level not statedSource excerptLong context | MRCR v2 (8-needle) Long context performance | 128k (average) | 77.3%Location Gemini 3.5 Flash model card Evaluation table, MRCR v2 (8-needle) 128k (average) row, Gemini 3.5 Flash column. In-house computation basis: methodology PDF, Long Context / MRCR v2 | |
| 3 | Gemini 3 Flash Preview | not stated | 67.2% | — | Gemini 3.5 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.google/models/evals-methodology/gemini-3-5-flash): All of the results are all run with the Gemini API ... with default sampling settings unless indicated otherwise. All models computed in-house; cumulative score up to 128k. Column heading is Gemini 3 Flash (gemini-3-flash-preview is the only match in the Gemini API model list). thinking level not statedSource excerptLong context | MRCR v2 (8-needle) Long context performance | 128k (average) | 67.2%Location Gemini 3.5 Flash model card Evaluation table, MRCR v2 (8-needle) 128k (average) row, Gemini 3 Flash column. In-house computation basis: methodology PDF, Long Context / MRCR v2 |