GDP.PDF
The all-pass rate on business tasks involving PDFs.
- Category
- Knowledge
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 3total
- All model rankings (records) · Ranked results: 4
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
Show rankings including legacy and unavailable models (entries: 4)
official results (Gemini 3.8 Flash model card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 3.8 Flash | not stated | 35.0% | — | Gemini 3.8 Flash model cardRetrieved 2026-11-12 · Vendor-reported value. Self-reported by Google (model card, as of 2026-09). thinking setting not statedSource excerptGDP.PDF (all pass rate) | 35.0% |
official results (Kimi K3.1 Pro (Hugging Face model card, moonshotai))
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Kimi K3.1 Pro | Max | 34.6% | — | Moonshot AI | Kimi K3.1 Pro (Hugging Face model card, moonshotai)Retrieved 2026-11-13 · Vendor-reported value (self-reported by Moonshot AI). Table column heading Kimi K3.1 Pro (max), table note: all Kimi K3.1 Pro results use reasoning effort max, temperature 1.0, top-p 0.95. Strict pass rate for answers with all items graded; grading by Gemini-3.5-Flash Medium.Source excerptGDP.pdf | 34.6Location HF model card "3. Evaluation Results" table, GDP.pdf row, Kimi K3.1 Pro (max) column (leftmost numeric column). Supporting footnote: Reasoning 1 |
official results (Gemini 3.7 Flash model card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Gemini 3.7 Flash | not stated | 34.0% | — | Gemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. Gemini computed in-house. Metric name not statedSource excerptGDP.pdf Expert PDF document comprehension | 34.0%Location Gemini 3.7 Flash model card Evaluation table, GDP.pdf row, Gemini 3.7 Flash column. In-house computation basis: methodology PDF, Multimodal / GDP.PDF | |
| 2 | Gemini 3.6 Flash | not stated | 22.0% | — | Gemini 3.7 Flash model cardRetrieved 2026-11-13 · Vendor-reported value. Table in the Google model card. methodology PDF (deepmind.com/models/evals-methodology/gemini-3-7-flash): All of the results are run with the Gemini API ... with default sampling settings unless indicated otherwise. Gemini computed in-house. Metric name not statedSource excerptGDP.pdf Expert PDF document comprehension | 22.0%Location Gemini 3.7 Flash model card Evaluation table, GDP.pdf row, Gemini 3.6 Flash column. In-house computation basis: methodology PDF, Multimodal / GDP.PDF |