Model × effort table

Each row is a model and effort combination; columns show benchmark scores. Values link to sources. Select a column heading to sort. Values with different source types or measurement conditions (comparison groups) are kept separate. Sorting uses the comparison group with the most values in the first available source type for that column (official → third-party → paper); rows without that value come last.

  • official Official announcement
  • third-party third-party measurement
  • paper Paper
  • ≈Approximate value read from chart
  • measured/reported by: The party stated in the source as measuring or reporting the value (only where stated)

Rows: 183

Benchmark scores by model × effort
% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values%% · Sorted by official values% · Sorted by official values% · Sorted by official values%Elo · Sorted by official valuesEloElo · Sorted by official valuesElo%% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values%% · Sorted by official values% · Sorted by official values%% · Sorted by official values%% · Sorted by official values% · Sorted by official values%%ScoreScoreScore%%Score%%Score · Sorted by official valuesScore · Sorted by official values%Score%Score%%%%%% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values%% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values%% · Sorted by official values%ScoreScore%%%%%%%%%ScoreEloElo% · Sorted by official values% · Sorted by official values%% · Sorted by official valuesScore · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values%% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official values% · Sorted by official valuesScore · Sorted by official values% · Sorted by official values%%%% · Sorted by third-party values%%
Claude Fable 5.2Anthropic · not statednot stated———74.6%officialmeasured/reported by: Anthropic——69.9%officialmeasured/reported by: Anthropic—————1,785officialmeasured/reported by: Anthropic—66.1%officialmeasured/reported by: Anthropic51.4%officialmeasured/reported by: Anthropic—————89.3%officialmeasured/reported by: Anthropic——————————————64.9%officialmeasured/reported by: Anthropic——————————————————————————————————————173.44third-partymeasured/reported by: Epoch AI————————————————————————————
Claude Fable 5.2Anthropic · LowLow—————34.2%officialmeasured/reported by: Anthropic—53.2%officialmeasured/reported by: Cursor————————68.4%officialmeasured/reported by: Anthropic——————————64.2%officialmeasured/reported by: Anthropic—71.4%officialmeasured/reported by: Anthropic26.9officialmeasured/reported by: Anthropic—————————————————————————————————————————————————————————————————————————
Claude Fable 5.2Anthropic · MedMed—————37.6%officialmeasured/reported by: Anthropic—54.8%officialmeasured/reported by: Cursor————————68.6%officialmeasured/reported by: Anthropic——————————66.4%officialmeasured/reported by: Anthropic—73.6%officialmeasured/reported by: Anthropic32.4officialmeasured/reported by: Anthropic—————————————————————————————————————————————————————————————————————————
Claude Fable 5.2Anthropic · High (default)Highdefault—————45.3%officialmeasured/reported by: Anthropic—56.9%officialmeasured/reported by: Cursor————————71.5%officialmeasured/reported by: Anthropic——————————69.8%officialmeasured/reported by: Anthropic—79.3%officialmeasured/reported by: Anthropic61officialmeasured/reported by: Anthropic——————41.3%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————
Claude Fable 5.2Anthropic · XhighXhigh—————49.1%officialmeasured/reported by: Anthropic—56.3%officialmeasured/reported by: Cursor——1,751officialmeasured/reported by: Artificial Analysis—————73.4%officialmeasured/reported by: Anthropic——————————71.4%officialmeasured/reported by: Anthropic—80.6%officialmeasured/reported by: Anthropic74.1officialmeasured/reported by: Anthropic—————————————————————————————————————————————————————————————————————————
Claude Fable 5.2Anthropic · MaxMax67.6%officialmeasured/reported by: Anthropic————45.6%officialmeasured/reported by: Anthropic—60.0%officialmeasured/reported by: Cursor——1,831officialmeasured/reported by: Artificial Analysis—————74.2%officialmeasured/reported by: Anthropic73.2%officialmeasured/reported by: Anthropic————————91.6%officialmeasured/reported by: Anthropic73.4%officialmeasured/reported by: Anthropic—82.1%officialmeasured/reported by: Anthropic83.5officialmeasured/reported by: Anthropic———————67.7officialmeasured/reported by: Artificial Analysis—————————————————————————————93.9%third-partymeasured/reported by: Epoch AI95.1%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI99.7%third-partymeasured/reported by: Epoch AI94.0%third-partymeasured/reported by: Epoch AI79.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Claude Mythos 5.2Anthropic · not statednot stated———75.3%officialmeasured/reported by: Anthropic——————————————————————————————76.3%officialmeasured/reported by: Anthropic85.1officialmeasured/reported by: Anthropic————————————————————————————————————————————————————————————————————
Claude Mythos 5.2Anthropic · LowLow—————————————————————————————————72.4%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Mythos 5.2Anthropic · MedMed—————————————————————————————————73.3%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Mythos 5.2Anthropic · High (default)Highdefault—————————————————————————————————83.2%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Mythos 5.2Anthropic · XhighXhigh—————————————————————————————————88.1%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Mythos 5.2Anthropic · MaxMax—————————————————————————————————89.6%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Opus 5.5Anthropic · not statednot stated———58.7%officialmeasured/reported by: Anthropic——62.3%officialmeasured/reported by: Anthropic———1,846officialmeasured/reported by: Artificial Analysis—1,800officialmeasured/reported by: Anthropic—61.2%officialmeasured/reported by: Anthropic42.5%officialmeasured/reported by: Anthropic67.7%officialmeasured/reported by: Anthropic——81.8%officialmeasured/reported by: Anthropic—87.2%officialmeasured/reported by: Anthropic—————64.4%officialmeasured/reported by: Anthropic——————67.6%officialmeasured/reported by: Anthropic82.6officialmeasured/reported by: Anthropic39.4%officialmeasured/reported by: Anthropic21.3%officialmeasured/reported by: Anthropic—————————————————————————————————————168.54third-partymeasured/reported by: Epoch AI————————————————————————————
Claude Opus 5.5Anthropic · LowLow38.5%officialmeasured/reported by: Anthropic———47.3%officialmeasured/reported by: Anthropic14.7%officialmeasured/reported by: Anthropic—43.7%officialmeasured/reported by: Anthropic43.7%officialmeasured/reported by: Anthropic——1,224officialmeasured/reported by: Anthropic—1,285officialmeasured/reported by: Anthropic——23.3%officialmeasured/reported by: Zapier57.4%officialmeasured/reported by: Anthropic——————————57.0%officialmeasured/reported by: Anthropic31.2%officialmeasured/reported by: Anthropic31.2%officialmeasured/reported by: Anthropic6.3officialmeasured/reported by: Anthropic——59.4%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Opus 5.5Anthropic · Med (default)Meddefault57.6%officialmeasured/reported by: Anthropic———54.6%officialmeasured/reported by: Anthropic30.1%officialmeasured/reported by: Anthropic—52.5%officialmeasured/reported by: Anthropic52.5%officialmeasured/reported by: Anthropic——1,576officialmeasured/reported by: Anthropic—1,642officialmeasured/reported by: Anthropic——28.6%officialmeasured/reported by: Zapier63.0%officialmeasured/reported by: Anthropic——————————59.0%officialmeasured/reported by: Anthropic62.8%officialmeasured/reported by: Anthropic62.8%officialmeasured/reported by: Anthropic19.1officialmeasured/reported by: Anthropic——66.1%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Opus 5.5Anthropic · HighHigh64.2%officialmeasured/reported by: Anthropic———54.0%officialmeasured/reported by: Anthropic34.5%officialmeasured/reported by: Anthropic—56.0%officialmeasured/reported by: Anthropic56.0%officialmeasured/reported by: Anthropic——1,692officialmeasured/reported by: Anthropic—1,705officialmeasured/reported by: Anthropic——32.0%officialmeasured/reported by: Zapier63.9%officialmeasured/reported by: Anthropic——————————59.2%officialmeasured/reported by: Anthropic67.3%officialmeasured/reported by: Anthropic67.3%officialmeasured/reported by: Anthropic29.7officialmeasured/reported by: Anthropic——70.0%officialmeasured/reported by: Anthropic————————————————————————————————————————78.9%third-partymeasured/reported by: Epoch AI—1,506third-partymeasured/reported by: LMArena1,542third-partymeasured/reported by: LMArena——————————————————————————
Claude Opus 5.5Anthropic · XhighXhigh66.4%officialmeasured/reported by: Anthropic———51.4%officialmeasured/reported by: Anthropic43.4%officialmeasured/reported by: Anthropic—56.0%officialmeasured/reported by: Anthropic56.0%officialmeasured/reported by: Anthropic——1,820officialmeasured/reported by: Anthropic—1,780officialmeasured/reported by: Anthropic——34.4%officialmeasured/reported by: Zapier66.4%officialmeasured/reported by: Anthropic——————————62.4%officialmeasured/reported by: Anthropic71.3%officialmeasured/reported by: Anthropic71.3%officialmeasured/reported by: Anthropic54.5officialmeasured/reported by: Anthropic——76.4%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Opus 5.5Anthropic · MaxMax64.8%officialmeasured/reported by: Anthropic——58.7%officialmeasured/reported by: Anthropic54.4%officialmeasured/reported by: Anthropic45.5%officialmeasured/reported by: Anthropic—57.8%officialmeasured/reported by: Anthropic57.8%officialmeasured/reported by: Anthropic——1,846officialmeasured/reported by: Anthropic—1,822officialmeasured/reported by: Anthropic——40.0%officialmeasured/reported by: Zapier67.7%officialmeasured/reported by: Anthropic67.7%officialmeasured/reported by: Anthropic64.4%officialmeasured/reported by: Anthropic—81.8%officialmeasured/reported by: Anthropic——————89.0%officialmeasured/reported by: Anthropic64.4%officialmeasured/reported by: Anthropic72.3%officialmeasured/reported by: Anthropic72.3%officialmeasured/reported by: Anthropic65.3officialmeasured/reported by: Anthropic——81.3%officialmeasured/reported by: Anthropic————59.9officialmeasured/reported by: Artificial Analysis—————————————————————————————90.6%third-partymeasured/reported by: Epoch AI91.2%third-partymeasured/reported by: Epoch AI95.0%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI72.2%third-partymeasured/reported by: Epoch AI67.0%third-partymeasured/reported by: Epoch AI95.6%third-partymeasured/reported by: Epoch AI—————————————————————————————
Claude Sonnet 5.5Anthropic · not statednot stated——————————1,844officialmeasured/reported by: Artificial Analysis—1,824officialmeasured/reported by: Anthropic———64.5%officialmeasured/reported by: Anthropic64.5%officialmeasured/reported by: Anthropic——80.1%officialmeasured/reported by: Anthropic———————61.6%officialmeasured/reported by: Anthropic61.6%officialmeasured/reported by: Anthropic———————————————————————————————————————————————166.56third-partymeasured/reported by: Epoch AI————————————————————————————
Claude Sonnet 5.5Anthropic · LowLow20.0%officialmeasured/reported by: Anthropic20.0%officialmeasured/reported by: Anthropic———29.3%officialmeasured/reported by: Anthropic——35.8%officialmeasured/reported by: Anthropic——1,179officialmeasured/reported by: Anthropic—1,264officialmeasured/reported by: Anthropic————41.4%officialmeasured/reported by: Anthropic——57.9%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————————————
Claude Sonnet 5.5Anthropic · MedMed28.8%officialmeasured/reported by: Anthropic28.8%officialmeasured/reported by: Anthropic———36.5%officialmeasured/reported by: Anthropic——39.2%officialmeasured/reported by: Anthropic——1,324officialmeasured/reported by: Anthropic—1,461officialmeasured/reported by: Anthropic————43.2%officialmeasured/reported by: Anthropic——66.0%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————————————
Claude Sonnet 5.5Anthropic · High (default)Highdefault43.0%officialmeasured/reported by: Anthropic43.0%officialmeasured/reported by: Anthropic———49.4%officialmeasured/reported by: Anthropic——47.8%officialmeasured/reported by: Anthropic——1,551officialmeasured/reported by: Anthropic—1,634officialmeasured/reported by: Anthropic————47.9%officialmeasured/reported by: Anthropic——73.2%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————————————
Claude Sonnet 5.5Anthropic · XhighXhigh61.5%officialmeasured/reported by: Anthropic61.5%officialmeasured/reported by: Anthropic———52.1%officialmeasured/reported by: Anthropic52.1%officialmeasured/reported by: Anthropic——53.1%officialmeasured/reported by: Anthropic——1,731officialmeasured/reported by: Anthropic—1,746officialmeasured/reported by: Anthropic————53.0%officialmeasured/reported by: Anthropic——81.1%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————1,473third-partymeasured/reported by: LMArena1,500third-partymeasured/reported by: LMArena——————————————————————————
Claude Sonnet 5.5Anthropic · MaxMax70.6%officialmeasured/reported by: Anthropic70.6%officialmeasured/reported by: Anthropic——59.9%officialmeasured/reported by: Anthropic46.2%officialmeasured/reported by: Anthropic—61.9%officialmeasured/reported by: Proximal55.5%officialmeasured/reported by: Anthropic——1,840officialmeasured/reported by: Anthropic—1,811officialmeasured/reported by: Anthropic————56.9%officialmeasured/reported by: Anthropic——83.9%officialmeasured/reported by: Anthropic—————90.2%officialmeasured/reported by: Anthropic———————————63officialmeasured/reported by: Artificial Analysis—————————————————————————————95.6%third-partymeasured/reported by: Epoch AI88.8%third-partymeasured/reported by: Epoch AI80.5%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI46.5%third-partymeasured/reported by: Epoch AI59.0%third-partymeasured/reported by: Epoch AI97.8%third-partymeasured/reported by: Epoch AI—————————————————————————————
Claude Haiku 5.5Anthropic · not statednot stated————46.4%officialmeasured/reported by: Anthropic———————1,578officialmeasured/reported by: Anthropic———57.4%officialmeasured/reported by: Anthropic——————————46.4%officialmeasured/reported by: Anthropic———————————————————————————————————————————————160.43third-partymeasured/reported by: Epoch AI————————————————————————————
Claude Haiku 5.5Anthropic · LowLow12.7%officialmeasured/reported by: Anthropic—————————1,125officialmeasured/reported by: Anthropic——————30.9%officialmeasured/reported by: Anthropic——42.0%officialmeasured/reported by: Anthropic————————————————————————————————————————————————————24.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Claude Haiku 5.5Anthropic · Med (default)Meddefault20.3%officialmeasured/reported by: Anthropic—————————1,277officialmeasured/reported by: Anthropic——————35.5%officialmeasured/reported by: Anthropic——53.3%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————————————
Claude Haiku 5.5Anthropic · HighHigh24.8%officialmeasured/reported by: Anthropic—————————1,420officialmeasured/reported by: Anthropic——————39.7%officialmeasured/reported by: Anthropic——61.3%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————97.2%third-partymeasured/reported by: Epoch AI————1,422third-partymeasured/reported by: LMArena1,454third-partymeasured/reported by: LMArena——————————————————————————
Claude Haiku 5.5Anthropic · XhighXhigh31.5%officialmeasured/reported by: Anthropic—————————1,513officialmeasured/reported by: Anthropic——————44.1%officialmeasured/reported by: Anthropic——67.6%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————98.9%third-partymeasured/reported by: Epoch AI————————————————————————————————
Claude Haiku 5.5Anthropic · MaxMax39.2%officialmeasured/reported by: Anthropic——20.6%officialmeasured/reported by: Anthropic——43.8%officialmeasured/reported by: Proximal———1,620officialmeasured/reported by: Anthropic——————45.9%officialmeasured/reported by: Anthropic——72.4%officialmeasured/reported by: Anthropic—————86.2%officialmeasured/reported by: Anthropic———————————58.4officialmeasured/reported by: Artificial Analysis—————————————————————————————89.7%third-partymeasured/reported by: Epoch AI75.1%third-partymeasured/reported by: Epoch AI46.3%third-partymeasured/reported by: Epoch AI—23.8%third-partymeasured/reported by: Epoch AI55.0%third-partymeasured/reported by: Epoch AI78.9%third-partymeasured/reported by: Epoch AI—————————————————————————————
Claude Fable 5.1Anthropic · not statednot stated———52.6%officialmeasured/reported by: Anthropic52.6%officialmeasured/reported by: Anthropic——56.3%officialmeasured/reported by: Anthropic—————1,669officialmeasured/reported by: Anthropic—61.5%officialmeasured/reported by: Anthropic31.4%officialmeasured/reported by: Zapier31.4%officialmeasured/reported by: Anthropic65.6%officialmeasured/reported by: Anthropic——80.7%officialmeasured/reported by: Anthropic—83.5%officialmeasured/reported by: Anthropic————88.4%officialmeasured/reported by: Anthropic—————————27.6%officialmeasured/reported by: Anthropic17.9%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————
Claude Fable 5.1Anthropic · LowLow40.2%officialmeasured/reported by: Anthropic———52.8%officialmeasured/reported by: Anthropic20.6%officialmeasured/reported by: Anthropic—45.1%officialmeasured/reported by: Anthropic——1,450officialmeasured/reported by: Anthropic—————60.2%officialmeasured/reported by: Anthropic——————————36.6%officialmeasured/reported by: Anthropic63.3%officialmeasured/reported by: Anthropic63.3%officialmeasured/reported by: Anthropic12.1officialmeasured/reported by: Anthropic—————————————————————————————————————————————————————————————————————————
Claude Fable 5.1Anthropic · MedMed43.4%officialmeasured/reported by: Anthropic———50.9%officialmeasured/reported by: Anthropic21.5%officialmeasured/reported by: Anthropic—46.8%officialmeasured/reported by: Anthropic——1,536officialmeasured/reported by: Anthropic—————62.4%officialmeasured/reported by: Anthropic——————————42.2%officialmeasured/reported by: Anthropic64.5%officialmeasured/reported by: Anthropic64.5%officialmeasured/reported by: Anthropic15.7officialmeasured/reported by: Anthropic—————————————————————————————————————————————————————————————————————————
Claude Fable 5.1Anthropic · High (default)Highdefault49.4%officialmeasured/reported by: Anthropic———50.3%officialmeasured/reported by: Anthropic25.7%officialmeasured/reported by: Anthropic—49.2%officialmeasured/reported by: Anthropic——1,617officialmeasured/reported by: Anthropic—————63.1%officialmeasured/reported by: Anthropic——————————46.0%officialmeasured/reported by: Anthropic66.7%officialmeasured/reported by: Anthropic66.7%officialmeasured/reported by: Anthropic25.8officialmeasured/reported by: Anthropic—————————————————————————————————————————————————————————————————————————
Claude Fable 5.1Anthropic · XhighXhigh51.3%officialmeasured/reported by: Anthropic———48.7%officialmeasured/reported by: Anthropic32.4%officialmeasured/reported by: Anthropic—51.6%officialmeasured/reported by: Anthropic——1,721officialmeasured/reported by: Anthropic—————65.2%officialmeasured/reported by: Anthropic——————————47.0%officialmeasured/reported by: Anthropic67.7%officialmeasured/reported by: Anthropic67.7%officialmeasured/reported by: Anthropic40.5officialmeasured/reported by: Anthropic—————————————————————————————————————————————————————————————————————————
Claude Fable 5.1Anthropic · MaxMax55.8%officialmeasured/reported by: Anthropic———50.3%officialmeasured/reported by: Anthropic31.7%officialmeasured/reported by: Anthropic—51.8%officialmeasured/reported by: Anthropic——1,735officialmeasured/reported by: Anthropic—————65.6%officialmeasured/reported by: Anthropic——————————44.8%officialmeasured/reported by: Anthropic68.7%officialmeasured/reported by: Anthropic68.7%officialmeasured/reported by: Anthropic44.4officialmeasured/reported by: Anthropic—————————————————————————————————————————————————————————————————————————
Claude Mythos 5.1Anthropic · not statednot stated——————————————————————————————————61.7%officialmeasured/reported by: Anthropic79.1officialmeasured/reported by: Anthropic————————————————————————————————————————————————————————————————————
Claude Mythos 5.1Anthropic · LowLow—————————————————————————————————65.9%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Mythos 5.1Anthropic · MedMed—————————————————————————————————69.8%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Mythos 5.1Anthropic · High (default)Highdefault—————————————————————————————————73.8%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Mythos 5.1Anthropic · XhighXhigh—————————————————————————————————77.8%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Mythos 5.1Anthropic · MaxMax—————————————————————————————————78.3%officialmeasured/reported by: Anthropic——————————————————————————————————————————————————————————————————————
Claude Fable 5Anthropic · not statednot stated———————————————————————————————————————————————————————————————————————————164.13third-partymeasured/reported by: Epoch AI————————————————————————————
Claude Fable 5Anthropic · LowLow————————————————————————————————————————————————————————————————————78.8%third-partymeasured/reported by: Epoch AI——97.8%third-partymeasured/reported by: Epoch AI—31.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Claude Fable 5Anthropic · High (default)Highdefault————————————————————————————————————————————————————————————————————83.3%third-partymeasured/reported by: Epoch AI——100.0%third-partymeasured/reported by: Epoch AI—45.0%third-partymeasured/reported by: Epoch AI63.9%third-partymeasured/reported by: Epoch AI—————————————————————————————
Claude Fable 5Anthropic · XhighXhigh————————————————————————————————————————————————————————————————————————70.7%third-partymeasured/reported by: Epoch AI———————————————————————————————
Claude Fable 5Anthropic · MaxMax————————————————————————————————————————————————————————————————————85.9%third-partymeasured/reported by: Epoch AI87.0%third-partymeasured/reported by: Epoch AI90.2%third-partymeasured/reported by: Epoch AI99.7%third-partymeasured/reported by: Epoch AI—47.0%third-partymeasured/reported by: Epoch AI70.0%third-partymeasured/reported by: Epoch AI——————————————————————————39.7%third-partymeasured/reported by: Sierra——
Claude Opus 5Anthropic · not statednot stated———29.0%officialmeasured/reported by: Anthropic————————————63.6%officialmeasured/reported by: Anthropic——74.0%officialmeasured/reported by: Anthropic——————83.4%officialmeasured/reported by: Anthropic—————————————————————————————————————————————————————————————————————————————
Claude Opus 5Anthropic · LowLow28.5%officialmeasured/reported by: Anthropic———42.0%officialmeasured/reported by: Anthropic——40.7%officialmeasured/reported by: Anthropic——1,294officialmeasured/reported by: Anthropic————20.4%officialmeasured/reported by: Zapier————————————50.5%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————
Claude Opus 5Anthropic · MedMed41.2%officialmeasured/reported by: Anthropic———53.4%officialmeasured/reported by: Anthropic——43.3%officialmeasured/reported by: Anthropic——1,476officialmeasured/reported by: Anthropic————23.9%officialmeasured/reported by: Zapier————————————58.1%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————
Claude Opus 5Anthropic · High (default)Highdefault47.0%officialmeasured/reported by: Anthropic———48.0%officialmeasured/reported by: Anthropic——44.7%officialmeasured/reported by: Anthropic——1,581officialmeasured/reported by: Anthropic————20.6%officialmeasured/reported by: Zapier————————————64.6%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————
Claude Opus 5Anthropic · XhighXhigh50.6%officialmeasured/reported by: Anthropic———43.6%officialmeasured/reported by: Anthropic——46.1%officialmeasured/reported by: Anthropic——1,676officialmeasured/reported by: Anthropic————25.3%officialmeasured/reported by: Zapier————————————67.0%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————
Claude Opus 5Anthropic · MaxMax52.3%officialmeasured/reported by: Anthropic———48.0%officialmeasured/reported by: Anthropic——46.6%officialmeasured/reported by: Anthropic——1,708officialmeasured/reported by: Anthropic————26.9%officialmeasured/reported by: Zapier————————————67.2%officialmeasured/reported by: Anthropic————————————————————————————————————————————————————————————————————————48.7%third-partymeasured/reported by: Sierra——
Claude Opus 4.8Anthropic · not statednot stated————————————————————————————————————————————————————————————————————85.4%third-partymeasured/reported by: Epoch AI——84.4%third-partymeasured/reported by: Epoch AI—19.0%third-partymeasured/reported by: Epoch AI—159.94third-partymeasured/reported by: Epoch AI————————————————————————————
Claude Opus 4.8Anthropic · LowLow————————————————————————————————————————————————————————————————————88.4%third-partymeasured/reported by: Epoch AI——97.8%third-partymeasured/reported by: Epoch AI—29.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Claude Opus 4.8Anthropic · MaxMax————————————————————————————————————————————————————————————————————91.0%third-partymeasured/reported by: Epoch AI80.0%third-partymeasured/reported by: Epoch AI56.1%third-partymeasured/reported by: Epoch AI98.3%third-partymeasured/reported by: Epoch AI53.0%third-partymeasured/reported by: Epoch AI52.0%third-partymeasured/reported by: Epoch AI65.6%third-partymeasured/reported by: Epoch AI——————————————————————————39.7%third-partymeasured/reported by: Sierra——
Claude Opus 4.7Anthropic · not statednot stated———————————————————————————————————————————————————————————————————————————157.44third-partymeasured/reported by: Epoch AI————————————82.3%officialmeasured/reported by: Anthropic———————————————
Claude Opus 4.7Anthropic · LowLow—————————————————————————————————————————————————————————————————————————26.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Claude Opus 4.7Anthropic · High (default)Highdefault——————————————————————————————————————————————————————————————————————————31.1%third-partymeasured/reported by: Epoch AI—————————————————————————————
Claude Opus 4.7Anthropic · XhighXhigh————————————————————————————————————————————————————————————————————90.2%third-partymeasured/reported by: Epoch AI——97.8%third-partymeasured/reported by: Epoch AI51.7%third-partymeasured/reported by: Epoch AI36.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Claude Opus 4.7Anthropic · MaxMax————————————————————————————————————————————————————————————————————86.4%third-partymeasured/reported by: Epoch AI70.2%third-partymeasured/reported by: Epoch AI31.7%third-partymeasured/reported by: Epoch AI86.7%third-partymeasured/reported by: Epoch AI—41.0%third-partymeasured/reported by: Epoch AI———————————————————————————40.2%third-partymeasured/reported by: Sierra——
Claude Opus 4.6Anthropic · not statednot stated——————————————————————————————————————————————————————————————73.8%officialmeasured/reported by: Anthropic————————————156.34third-partymeasured/reported by: Epoch AI————————————————————————————
Claude Opus 4.6Anthropic · MaxMax————————————————53.0%officialmeasured/reported by: Anthropic———————————————————————————————————————————————————88.4%third-partymeasured/reported by: Epoch AI66.0%third-partymeasured/reported by: Epoch AI26.8%third-partymeasured/reported by: Epoch AI91.1%third-partymeasured/reported by: Epoch AI47.0%third-partymeasured/reported by: Epoch AI21.0%third-partymeasured/reported by: Epoch AI33.3%third-partymeasured/reported by: Epoch AI——————————————————————————27.3%third-partymeasured/reported by: Sierra——
Claude Opus 4.5Anthropic · not statednot stated————————————————————————————————————————————————————————————————————80.7%third-partymeasured/reported by: Epoch AI——48.1%third-partymeasured/reported by: Epoch AI—5.0%third-partymeasured/reported by: Epoch AI—151.92third-partymeasured/reported by: Epoch AI————————————————————————————
Claude Opus 4.5Anthropic · High (default)Highdefault————————————————————————————————————————————————————————————————————————————————————————————————————84.0%third-partymeasured/reported by: Sierra24.7%third-partymeasured/reported by: Sierra79.6%third-partymeasured/reported by: Sierra92.3%third-partymeasured/reported by: Sierra
Claude Sonnet 5Anthropic · not statednot stated——————————1,449officialmeasured/reported by: Artificial Analysis—————54.9%officialmeasured/reported by: Anthropic——57.0%officialmeasured/reported by: Anthropic———————15.6%officialmeasured/reported by: Anthropic————————————————————————————————————————————————————————————————————————————
Claude Sonnet 5Anthropic · LowLow3.2%officialmeasured/reported by: Anthropic———28.7%officialmeasured/reported by: Anthropic——24.1%officialmeasured/reported by: Anthropic————923officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————————————————————
Claude Sonnet 5Anthropic · MedMed4.4%officialmeasured/reported by: Anthropic———35.2%officialmeasured/reported by: Anthropic——28.0%officialmeasured/reported by: Anthropic————1,056officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————————————————————
Claude Sonnet 5Anthropic · High (default)Highdefault4.5%officialmeasured/reported by: Anthropic———39.4%officialmeasured/reported by: Anthropic——30.8%officialmeasured/reported by: Anthropic————1,177officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————————————————————
Claude Sonnet 5Anthropic · XhighXhigh7.0%officialmeasured/reported by: Anthropic———42.7%officialmeasured/reported by: Anthropic——32.0%officialmeasured/reported by: Anthropic————1,274officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————————————————————
Claude Sonnet 5Anthropic · MaxMax10.3%officialmeasured/reported by: Anthropic———42.4%officialmeasured/reported by: Anthropic——34.1%officialmeasured/reported by: Anthropic————1,359officialmeasured/reported by: Anthropic———————————————————————————————————————————————————————————————————————————————————————————
Claude Sonnet 4.6Anthropic · not statednot stated———————————————————————————————————————————————————————————————————————————152.86third-partymeasured/reported by: Epoch AI————————————————————————————
Claude Sonnet 4.6Anthropic · MedMed————————————————————————————————————————————————————————————————————83.3%third-partymeasured/reported by: Epoch AI——82.2%third-partymeasured/reported by: Epoch AI—16.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Claude Sonnet 4.6Anthropic · High (default)Highdefault————————————————————————————————————————————————————————————————————83.3%third-partymeasured/reported by: Epoch AI——75.6%third-partymeasured/reported by: Epoch AI35.5%third-partymeasured/reported by: Epoch AI19.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Claude Sonnet 4.6Anthropic · MaxMax————————————————————————————————————————————————————————————————————78.8%third-partymeasured/reported by: Epoch AI——71.1%third-partymeasured/reported by: Epoch AI32.8%third-partymeasured/reported by: Epoch AI23.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Claude Sonnet 4.5Anthropic · not statednot stated————————————————————————————————————————————————————————————————————73.7%third-partymeasured/reported by: Epoch AI——35.6%third-partymeasured/reported by: Epoch AI23.7%third-partymeasured/reported by: Epoch AI6.0%third-partymeasured/reported by: Epoch AI—147.63third-partymeasured/reported by: Epoch AI————————————————————————72.0%third-partymeasured/reported by: Sierra25.3%third-partymeasured/reported by: Sierra72.4%third-partymeasured/reported by: Sierra84.9%third-partymeasured/reported by: Sierra
Claude Haiku 4.5Anthropic · not statednot stated0.0%officialmeasured/reported by: Anthropic—————————735officialmeasured/reported by: Anthropic—614officialmeasured/reported by: Anthropic———18.7%officialmeasured/reported by: Anthropic10.2%officialmeasured/reported by: Anthropic——15.7%officialmeasured/reported by: Anthropic——————6.4%officialmeasured/reported by: Anthropic————————————————————————————————————————————————————————————————————————————
GPT-6 AstraOpenAI · not statednot stated———64.6%officialmeasured/reported by: OpenAI68.1%official——65.5%official—————1,569official—52.0%official41.4%official57.2%official57.2%official————79.5%official—————71.0%official————————29.8%officialmeasured/reported by: Anthropic20.8%official64.7officialmeasured/reported by: OpenAI36.6officialmeasured/reported by: OpenAI——————————————————————————————82.9%third-partymeasured/reported by: Epoch AI————169third-partymeasured/reported by: Epoch AI————————————————————————————
GPT-6 AstraOpenAI · LowLow49.7%officialmeasured/reported by: OpenAI———45.3%official31.1%official————1,366official————30.3%officialmeasured/reported by: Zapier——————————————————————————————————————————————————————87.8%third-partymeasured/reported by: Epoch AI—————————————————————————————————
GPT-6 AstraOpenAI · MedMed53.9%officialmeasured/reported by: OpenAI———48.8%official36.8%official————1,468official————34.1%officialmeasured/reported by: Zapier——————————————————————————————————————————————————————97.6%third-partymeasured/reported by: Epoch AI—————————————————————————————————
GPT-6 AstraOpenAI · HighHigh57.9%officialmeasured/reported by: OpenAI———50.9%official38.3%official————1,485official————37.1%officialmeasured/reported by: Zapier——————————————————————————————————————————————————————97.6%third-partymeasured/reported by: Epoch AI———46.7%third-partymeasured/reported by: Epoch AI—————————————————————————————
GPT-6 AstraOpenAI · XhighXhigh57.6%officialmeasured/reported by: OpenAI———50.6%official41.4%official————1,516official————39.0%officialmeasured/reported by: Zapier——————————————————————————————————————————————————————97.6%third-partymeasured/reported by: Epoch AI—————————————————————————————————
GPT-6 AstraOpenAI · MaxMax56.7%officialmeasured/reported by: OpenAI———53.3%official42.8%official————1,542official————41.4%officialmeasured/reported by: Zapier————————————————————————————————————————————————————95.8%third-partymeasured/reported by: Epoch AI93.7%third-partymeasured/reported by: Epoch AI97.6%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI75.6%third-partymeasured/reported by: Epoch AI74.0%third-partymeasured/reported by: Epoch AI60.0%third-partymeasured/reported by: Epoch AI—1,474third-partymeasured/reported by: LMArena1,494third-partymeasured/reported by: LMArena——————————————————————————
GPT-6.1 SolOpenAI · not statednot stated——————————1,609officialmeasured/reported by: Artificial Analysis—1,555officialmeasured/reported by: Artificial Analysis—————————————————————————64.2officialmeasured/reported by: OpenAI36.2officialmeasured/reported by: OpenAI———————————————————————————————————168.48third-partymeasured/reported by: Epoch AI————————————————————————————
GPT-6.1 SolOpenAI · MaxMax———57.0%officialmeasured/reported by: OpenAI————————————————————————————————————————————————————————————————95.4%third-partymeasured/reported by: Epoch AI93.7%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI73.9%third-partymeasured/reported by: Epoch AI68.0%third-partymeasured/reported by: Epoch AI61.1%third-partymeasured/reported by: Epoch AI—1,482third-partymeasured/reported by: LMArena1,486third-partymeasured/reported by: LMArena——————————————————————————
GPT-6.1 TerraOpenAI · not statednot stated——————————————————————————————————————62.7officialmeasured/reported by: OpenAI31.4officialmeasured/reported by: OpenAI———————————————————————————————————167.67third-partymeasured/reported by: Epoch AI————————————————————————————
GPT-6.1 TerraOpenAI · MaxMax————————————————————————————————————————————————————————————————————94.3%third-partymeasured/reported by: Epoch AI90.9%third-partymeasured/reported by: Epoch AI92.7%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI57.3%third-partymeasured/reported by: Epoch AI—76.7%third-partymeasured/reported by: Epoch AI—————————————————————————————
GPT-6 LunaOpenAI · not statednot stated16.4%official———42.4%official———————1,336official——————————————29.1%official——————————60.8officialmeasured/reported by: OpenAI31.4officialmeasured/reported by: OpenAI———————————————————————————————————156.41third-partymeasured/reported by: Epoch AI————————————————————————————
GPT-6 LunaOpenAI · LowLow——————————1,036official—————————19.2%official———————————————————————————————————————————————————————————————————————————————————
GPT-6 LunaOpenAI · Med (default)Meddefault——————————1,262official—————————37.5%official———————————————————————————————————————————————————————————————————————————————————
GPT-6 LunaOpenAI · HighHigh——————————1,344official—————————42.3%official———————————————————————————————————————————————————————————————————————————————————
GPT-6 LunaOpenAI · XhighXhigh——————————1,364official—————————44.8%official———————————————————————————————————————————————————————————————————————————————————
GPT-6 LunaOpenAI · MaxMax——————————1,437official—————————48.9%official———————————————————————————————————————————————90.5%third-partymeasured/reported by: Epoch AI79.0%third-partymeasured/reported by: Epoch AI56.1%third-partymeasured/reported by: Epoch AI98.9%third-partymeasured/reported by: Epoch AI41.4%third-partymeasured/reported by: Epoch AI36.0%third-partymeasured/reported by: Epoch AI26.7%third-partymeasured/reported by: Epoch AI—1,441third-partymeasured/reported by: LMArena1,432third-partymeasured/reported by: LMArena——————————————————————————
GPT-6 SolOpenAI · not statednot stated——————————1,487officialmeasured/reported by: Artificial Analysis————————————————53.6%official———————————————————————————————————————————————163.75third-partymeasured/reported by: Epoch AI————————————————————————————
GPT-6 SolOpenAI · LowLow————37.3%official———————905official———————————————————————————————————————————————————————————————————————————————————————————
GPT-6 SolOpenAI · Med (default)Meddefault————45.9%official———————1,142official———————————————————————————————————————————————————————————————————————————————————————————
GPT-6 SolOpenAI · HighHigh————47.7%official———————1,289official———————————————————————————————————————————————————————————————————————————————————————————
GPT-6 SolOpenAI · XhighXhigh————48.4%official———————1,364official———————————————————————————————————————————————————————————————————————————————————————————
GPT-6 SolOpenAI · MaxMax————49.3%official———————1,483official———————————————————————————————————————————————————————94.3%third-partymeasured/reported by: Epoch AI89.8%third-partymeasured/reported by: Epoch AI90.0%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI60.7%third-partymeasured/reported by: Epoch AI56.0%third-partymeasured/reported by: Epoch AI48.9%third-partymeasured/reported by: Epoch AI—————————————————————————————
GPT-5.6 SolOpenAI · not statednot stated———22.4%official——————————————————————————————————60.5officialmeasured/reported by: OpenAI33.1officialmeasured/reported by: OpenAI———————————————————————————————————162.99third-partymeasured/reported by: Epoch AI————————————————————————————
GPT-5.6 SolOpenAI · NoneNone————————————————————————————————————————————————————————————————————82.8%third-partymeasured/reported by: Epoch AI——68.9%third-partymeasured/reported by: Epoch AI—7.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GPT-5.6 SolOpenAI · LowLow7.9%officialmeasured/reported by: OpenAI———35.4%official——24.6%official24.6%official——1,289official————11.7%officialmeasured/reported by: Zapier————————————————————————————————————————————————————89.9%third-partymeasured/reported by: Epoch AI——95.6%third-partymeasured/reported by: Epoch AI—31.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GPT-5.6 SolOpenAI · Med (default)Meddefault20.9%officialmeasured/reported by: OpenAI———39.9%official——31.1%official31.1%official——1,403official————19.6%officialmeasured/reported by: Zapier————————————————————————————————————————————————————————————————————————————————————————
GPT-5.6 SolOpenAI · HighHigh26.1%officialmeasured/reported by: OpenAI———45.1%official——35.7%official35.7%official——1,480official————24.8%officialmeasured/reported by: Zapier——————————————————————————————————————————————————————————20.0%third-partymeasured/reported by: Epoch AI—————————————————————————————
GPT-5.6 SolOpenAI · XhighXhigh28.5%officialmeasured/reported by: OpenAI———46.8%official——37.7%official37.7%official——1,548official————26.3%officialmeasured/reported by: Zapier—————————————————————————————————————————————————————————————————————————————————————46.9%third-partymeasured/reported by: Sierra——
GPT-5.6 SolOpenAI · MaxMax37.3%officialmeasured/reported by: OpenAI———47.5%official——41.7%official41.7%official——1,588official————28.8%officialmeasured/reported by: Zapier————————————————————————————————————————————————————93.5%third-partymeasured/reported by: Epoch AI89.1%third-partymeasured/reported by: Epoch AI82.9%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI69.7%third-partymeasured/reported by: Epoch AI59.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GPT-5.6 TerraOpenAI · not statednot stated——————————————————————————————————————57.7officialmeasured/reported by: OpenAI32.7officialmeasured/reported by: OpenAI———————————————————————————————————160.73third-partymeasured/reported by: Epoch AI————————————————————————————
GPT-5.6 TerraOpenAI · NoneNone————————————————————————————————————————————————————————————————————77.3%third-partymeasured/reported by: Epoch AI——53.3%third-partymeasured/reported by: Epoch AI—5.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GPT-5.6 TerraOpenAI · LowLow————————————————————————————————————————————————————————————————————87.4%third-partymeasured/reported by: Epoch AI——88.9%third-partymeasured/reported by: Epoch AI—27.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GPT-5.6 TerraOpenAI · MaxMax————————————————————————————————————————————————————————————————————93.3%third-partymeasured/reported by: Epoch AI86.0%third-partymeasured/reported by: Epoch AI70.7%third-partymeasured/reported by: Epoch AI99.7%third-partymeasured/reported by: Epoch AI43.2%third-partymeasured/reported by: Epoch AI47.0%third-partymeasured/reported by: Epoch AI41.1%third-partymeasured/reported by: Epoch AI—————————————————————————————
GPT-5.6 LunaOpenAI · not statednot stated——————————————————————————————————————55.7officialmeasured/reported by: OpenAI32officialmeasured/reported by: OpenAI———————————————————————————————————156.67third-partymeasured/reported by: Epoch AI————————————————————————————
GPT-5.6 LunaOpenAI · NoneNone————————————————————————————————————————————————————————————————————63.6%third-partymeasured/reported by: Epoch AI39.7%third-partymeasured/reported by: Epoch AI—40.0%third-partymeasured/reported by: Epoch AI—3.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GPT-5.6 LunaOpenAI · LowLow————————————————————————————————————————————————————————————————————82.3%third-partymeasured/reported by: Epoch AI41.4%third-partymeasured/reported by: Epoch AI—66.7%third-partymeasured/reported by: Epoch AI—17.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GPT-5.6 LunaOpenAI · MaxMax————————————————————————————————————————————————————————————————————91.6%third-partymeasured/reported by: Epoch AI82.1%third-partymeasured/reported by: Epoch AI61.0%third-partymeasured/reported by: Epoch AI98.3%third-partymeasured/reported by: Epoch AI41.0%third-partymeasured/reported by: Epoch AI43.0%third-partymeasured/reported by: Epoch AI21.1%third-partymeasured/reported by: Epoch AI—————————————————————————————
GPT-5.5OpenAI · not statednot stated———————————————————————————————————————————————————————————————————————————160.1third-partymeasured/reported by: Epoch AI————————————————————————————
GPT-5.5OpenAI · NoneNone————————————————————————————————————————————————————————————————————77.3%third-partymeasured/reported by: Epoch AI——57.8%third-partymeasured/reported by: Epoch AI—9.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GPT-5.5OpenAI · LowLow————————————————————————————————————————————————————————————————————90.7%third-partymeasured/reported by: Epoch AI——84.4%third-partymeasured/reported by: Epoch AI—30.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GPT-5.5OpenAI · HighHigh——————————————————————————————————————————————————————————————————————————10.0%third-partymeasured/reported by: Epoch AI—————————————————————————————
GPT-5.5OpenAI · XhighXhigh—————————————————————————————————————————————————————————————————————85.3%third-partymeasured/reported by: Epoch AI72.5%third-partymeasured/reported by: Epoch AI—63.0%third-partymeasured/reported by: Epoch AI63.0%third-partymeasured/reported by: Epoch AI23.3%third-partymeasured/reported by: Epoch AI——————————————————————————44.6%third-partymeasured/reported by: Sierra——
GPT-5.4OpenAI · XhighXhigh—————————————————————————————————————————————————————————————————————————————————————————————————————39.4%third-partymeasured/reported by: Sierra——
GPT-5.2OpenAI · None (default)Nonedefault————————————————————————————————————————————————————————————————————————————————————————————————————52.5%third-partymeasured/reported by: Sierra12.6%third-partymeasured/reported by: Sierra75.0%third-partymeasured/reported by: Sierra57.2%third-partymeasured/reported by: Sierra
GPT-5.2OpenAI · HighHigh————————————————————————————————————————————————————————————————————————————————————————————————————83.0%third-partymeasured/reported by: Sierra32.2%third-partymeasured/reported by: Sierra81.6%third-partymeasured/reported by: Sierra89.7%third-partymeasured/reported by: Sierra
Gemini 4 CarbonGoogle · not statednot stated———64.8%official——61.2%official—————1,611official—61.8%official53.9%official—————81.5%official—————72.5%official———————————————————————————————————————————————169.76third-partymeasured/reported by: Epoch AI————————————————————————————
Gemini 4 CarbonGoogle · LowLow—————32.4%official——————————————————————————————————————————————————————————————————————————————————————————————————
Gemini 4 CarbonGoogle · Med (default)Meddefault—————41.1%official——————————————————————————————————————————————————————————————————————————————————————————————————
Gemini 4 CarbonGoogle · HighHigh65.2%officialmeasured/reported by: Artificial Analysis——64.8%officialmeasured/reported by: Artificial Analysis—38.4%official61.2%officialmeasured/reported by: Proximal——9.6%officialmeasured/reported by: Google—————53.9%officialmeasured/reported by: Zapier—————81.5%officialmeasured/reported by: Google—77.4%officialmeasured/reported by: Google———72.5%official—————————————59officialmeasured/reported by: Artificial Analysis70.4%officialmeasured/reported by: Vals AI16,484officialmeasured/reported by: Andon Labs58.6%officialmeasured/reported by: Andon Labs96.2%officialmeasured/reported by: Google—72.0%officialmeasured/reported by: Surge AI71.0%officialmeasured/reported by: Collinear AI / Artificial Analysis54.8%officialmeasured/reported by: Google88.2%officialmeasured/reported by: Google—————————————————96.5%third-partymeasured/reported by: Epoch AI90.5%third-partymeasured/reported by: Epoch AI95.1%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI77.7%third-partymeasured/reported by: Epoch AI78.0%third-partymeasured/reported by: Epoch AI——1,526third-partymeasured/reported by: LMArena1,563third-partymeasured/reported by: LMArena——————————————————————————
Gemini 4 ArgonGoogle · not statednot stated57.4%officialmeasured/reported by: Google———————77.9%officialmeasured/reported by: Google—————————————69.2%officialmeasured/reported by: Google—39.5%officialmeasured/reported by: Google—————————————————————99.7%officialmeasured/reported by: Google————65.4%officialmeasured/reported by: Google19.6%officialmeasured/reported by: Google91.9%officialmeasured/reported by: Google45.3%officialmeasured/reported by: Google88.8%officialmeasured/reported by: Google91.7%officialmeasured/reported by: Google——————————————————166.48third-partymeasured/reported by: Epoch AI————————————————————————————
Gemini 4 ArgonGoogle · HighHigh57.1%officialmeasured/reported by: Artificial Analysis——52.9%officialmeasured/reported by: Artificial Analysis——55.0%officialmeasured/reported by: Proximal————————51.3%officialmeasured/reported by: Zapier—————74.7%officialmeasured/reported by: Google—69.0%officialmeasured/reported by: Google———71.6%official—————————————50officialmeasured/reported by: Artificial Analysis69.2%officialmeasured/reported by: Vals AI13,718officialmeasured/reported by: Andon Labs54.4%officialmeasured/reported by: Andon Labs84.2%officialmeasured/reported by: Google—76.0%officialmeasured/reported by: Surge AI68.0%officialmeasured/reported by: Collinear AI / Artificial Analysis42.0%officialmeasured/reported by: Google83.4%officialmeasured/reported by: Google—————————————————96.4%third-partymeasured/reported by: Epoch AI86.0%third-partymeasured/reported by: Epoch AI78.1%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI76.0%third-partymeasured/reported by: Epoch AI59.0%third-partymeasured/reported by: Epoch AI58.9%third-partymeasured/reported by: Epoch AI—1,522third-partymeasured/reported by: LMArena1,540third-partymeasured/reported by: LMArena——————————————————————————
Gemini 3.8 FlashGoogle · not statednot stated19.1%officialmeasured/reported by: Google—89.4%officialmeasured/reported by: Google—————73.7%officialmeasured/reported by: Google——1,545officialmeasured/reported by: Google——————54.9%officialmeasured/reported by: Google———59.0%officialmeasured/reported by: Google————————————————————————————61.4%officialmeasured/reported by: Google10.0%officialmeasured/reported by: Google——86.2%officialmeasured/reported by: Google87.8%officialmeasured/reported by: Google35.0%officialmeasured/reported by: Google86.2%officialmeasured/reported by: Google88.8%officialmeasured/reported by: Google56.5%officialmeasured/reported by: Google——————————————158.79third-partymeasured/reported by: Epoch AI————————————————————————————
Gemini 3.8 FlashGoogle · HighHigh————————————————————————————————————————————————————————————————————95.4%third-partymeasured/reported by: Epoch AI68.4%third-partymeasured/reported by: Epoch AI22.0%third-partymeasured/reported by: Epoch AI98.9%third-partymeasured/reported by: Epoch AI69.7%third-partymeasured/reported by: Epoch AI58.0%third-partymeasured/reported by: Epoch AI38.9%third-partymeasured/reported by: Epoch AI—————————————————————————————
Gemini 3.6 FlashGoogle · not statednot stated—5.4%officialmeasured/reported by: Google78.0%officialmeasured/reported by: Google———————————————51.2%officialmeasured/reported by: Google———33.8%officialmeasured/reported by: Google—24.2%officialmeasured/reported by: Google——————————————————————————————76.1%officialmeasured/reported by: Google84.2%officialmeasured/reported by: Google22.0%officialmeasured/reported by: Google85.2%officialmeasured/reported by: Google80.6%officialmeasured/reported by: Google41.2%officialmeasured/reported by: Google——————————————155.21third-partymeasured/reported by: Epoch AI—————————————89.4%officialmeasured/reported by: Google———————91.8%officialmeasured/reported by: Google——————
Gemini 3.6 FlashGoogle · MinimalMinimal————————————————————————————————————————————————————————————————————85.9%third-partymeasured/reported by: Epoch AI——80.0%third-partymeasured/reported by: Epoch AI—29.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Gemini 3.6 FlashGoogle · LowLow————————————————————————————————————————————————————————————————————86.4%third-partymeasured/reported by: Epoch AI——82.2%third-partymeasured/reported by: Epoch AI—42.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Gemini 3.6 FlashGoogle · HighHigh————————————————————————————————————————————————————————————————————94.1%third-partymeasured/reported by: Epoch AI59.0%third-partymeasured/reported by: Epoch AI22.0%third-partymeasured/reported by: Epoch AI94.2%third-partymeasured/reported by: Epoch AI66.2%third-partymeasured/reported by: Epoch AI40.0%third-partymeasured/reported by: Epoch AI23.3%third-partymeasured/reported by: Epoch AI—————————————————————————————
Gemini 3.5 Flash-LiteGoogle · not statednot stated———————————————————————————————————————————————————————————————————————————145.63third-partymeasured/reported by: Epoch AI————————————————————————————
Gemini 3.5 Flash-LiteGoogle · Minimal (default)Minimaldefault————————————————————————————————————————————————————————————————————74.2%third-partymeasured/reported by: Epoch AI——51.1%third-partymeasured/reported by: Epoch AI—7.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Gemini 3.5 Flash-LiteGoogle · LowLow————————————————————————————————————————————————————————————————————75.8%third-partymeasured/reported by: Epoch AI——60.0%third-partymeasured/reported by: Epoch AI—21.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Gemini 3.5 Flash-LiteGoogle · HighHigh————————————————————————————————————————————————————————————————————83.3%third-partymeasured/reported by: Epoch AI26.0%third-partymeasured/reported by: Epoch AI0.0%third-partymeasured/reported by: Epoch AI71.1%third-partymeasured/reported by: Epoch AI—16.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Gemini 3.1 Pro PreviewGoogle · not statednot stated——————————————————————————————————————————————————————————83.3%officialmeasured/reported by: Google—————————94.1%third-partymeasured/reported by: Epoch AI59.7%third-partymeasured/reported by: Epoch AI26.8%third-partymeasured/reported by: Epoch AI95.6%third-partymeasured/reported by: Epoch AI———156.18third-partymeasured/reported by: Epoch AI——54.2%officialmeasured/reported by: Google—————————76.2%officialmeasured/reported by: Google—80.5%officialmeasured/reported by: Google——————84.9%officialmeasured/reported by: Google26.3%officialmeasured/reported by: Google—————
Gemini 3.1 Pro PreviewGoogle · High (default)Highdefault————————————————————————————————————————————————————————————————————94.4%third-partymeasured/reported by: Epoch AI——95.6%third-partymeasured/reported by: Epoch AI73.5%third-partymeasured/reported by: Epoch AI51.0%third-partymeasured/reported by: Epoch AI8.9%third-partymeasured/reported by: Epoch AI——————————————————————————26.0%third-partymeasured/reported by: Sierra——
Gemini 3.1 Flash-LiteGoogle · not statednot stated———————————————————————————————————————————————————————————————————————————145.01third-partymeasured/reported by: Epoch AI————————————————————————————
Gemini 3.1 Flash-LiteGoogle · Minimal (default)Minimaldefault————————————————————————————————————————————————————————————————————73.7%third-partymeasured/reported by: Epoch AI21.4%third-partymeasured/reported by: Epoch AI—37.8%third-partymeasured/reported by: Epoch AI————————————————————————————————
Gemini 3.1 Flash-LiteGoogle · LowLow————————————————————————————————————————————————————————————————————74.2%third-partymeasured/reported by: Epoch AI22.5%third-partymeasured/reported by: Epoch AI—44.4%third-partymeasured/reported by: Epoch AI————————————————————————————————
Gemini 3.1 Flash-LiteGoogle · HighHigh————————————————————————————————————————————————————————————————————81.8%third-partymeasured/reported by: Epoch AI27.7%third-partymeasured/reported by: Epoch AI—80.0%third-partymeasured/reported by: Epoch AI————————————————————————————————
Gemini 3 Flash PreviewGoogle · not statednot stated——58.0%officialmeasured/reported by: Google———————————————————————————————————————————————————————80.3%officialmeasured/reported by: Google—————————83.2%third-partymeasured/reported by: Epoch AI51.2%third-partymeasured/reported by: Epoch AI17.1%third-partymeasured/reported by: Epoch AI92.8%third-partymeasured/reported by: Epoch AI———152.32third-partymeasured/reported by: Epoch AI——49.6%officialmeasured/reported by: Google—————————65.1%officialmeasured/reported by: Google—81.2%officialmeasured/reported by: Google——————67.2%officialmeasured/reported by: Google22.1%officialmeasured/reported by: Google—————
Gemini 3 Flash PreviewGoogle · High (default)Highdefault————————————————————————————————————————————————————————————————————89.4%third-partymeasured/reported by: Epoch AI——95.6%third-partymeasured/reported by: Epoch AI66.8%third-partymeasured/reported by: Epoch AI40.0%third-partymeasured/reported by: Epoch AI——————————————————————————82.5%third-partymeasured/reported by: Sierra27.3%third-partymeasured/reported by: Sierra76.8%third-partymeasured/reported by: Sierra91.2%third-partymeasured/reported by: Sierra
Gemini 2.5 ProGoogle · not statednot stated————————————————————————————————————————————————————————————————————85.3%third-partymeasured/reported by: Epoch AI24.6%third-partymeasured/reported by: Epoch AI0.0%third-partymeasured/reported by: Epoch AI84.7%third-partymeasured/reported by: Epoch AI———144.87third-partymeasured/reported by: Epoch AI————————————————————————————
Gemini 2.5 ProGoogle · HighHigh—————————————————————————————————————————————————————————————————————————————————————————————————————13.7%third-partymeasured/reported by: Sierra——
Gemini 2.5 FlashGoogle · not statednot stated———————————————————————————————————————————————————————————————————————————140.81third-partymeasured/reported by: Epoch AI————————————————————————————
Gemini 3.7 FlashGoogle · not statednot stated—14.9%officialmeasured/reported by: Google85.8%officialmeasured/reported by: Google———————————————53.6%officialmeasured/reported by: Google———47.9%officialmeasured/reported by: Google—26.3%officialmeasured/reported by: Google——————————————————————————————82.1%officialmeasured/reported by: Google85.4%officialmeasured/reported by: Google34.0%officialmeasured/reported by: Google84.5%officialmeasured/reported by: Google87.1%officialmeasured/reported by: Google43.5%officialmeasured/reported by: Google——————————————158.36third-partymeasured/reported by: Epoch AI—————————————88.7%officialmeasured/reported by: Google———————97.0%officialmeasured/reported by: Google——————
Gemini 3.7 FlashGoogle · HighHigh————————65.3%officialmeasured/reported by: Google———————————————————————————————————————————————————————————94.8%third-partymeasured/reported by: Epoch AI71.6%third-partymeasured/reported by: Epoch AI36.6%third-partymeasured/reported by: Epoch AI97.2%third-partymeasured/reported by: Epoch AI69.2%third-partymeasured/reported by: Epoch AI66.0%third-partymeasured/reported by: Epoch AI41.1%third-partymeasured/reported by: Epoch AI—————————————————————————————
Gemini 3.5 FlashGoogle · not statednot stated——76.2%officialmeasured/reported by: Google———————————————————————————————————————————————————————84.2%officialmeasured/reported by: Google———————————————————55.1%officialmeasured/reported by: Google—————————78.4%officialmeasured/reported by: Google—83.6%officialmeasured/reported by: Google——————77.3%officialmeasured/reported by: Google26.6%officialmeasured/reported by: Google—————
Gemini 3 Pro PreviewGoogle · High (default)Highdefault————————————————————————————————————————————————————————————————————————————————————————————————————80.5%third-partymeasured/reported by: Sierra18.0%third-partymeasured/reported by: Sierra75.9%third-partymeasured/reported by: Sierra91.0%third-partymeasured/reported by: Sierra
Grok 4.7xAI · not statednot stated———————————————————————————————————————————————————————————————————————————156.18third-partymeasured/reported by: Epoch AI————————————————————————————
Grok 4.7xAI · High (default)Highdefault————————71.0%officialmeasured/reported by: xAI———————————————————————————————————————————————————————————————————————————————————————————————
Grok 4.7xAI · XhighXhigh37.6%officialmeasured/reported by: xAI——————46.3%officialmeasured/reported by: xAI————1,657officialmeasured/reported by: xAI———————————————————————————56.7%officialmeasured/reported by: xAI———————————19.6%officialmeasured/reported by: xAI————————64.0%officialmeasured/reported by: xAI——————92.7%third-partymeasured/reported by: Epoch AI53.0%third-partymeasured/reported by: Epoch AI17.1%third-partymeasured/reported by: Epoch AI98.1%third-partymeasured/reported by: Epoch AI56.0%third-partymeasured/reported by: Epoch AI41.0%third-partymeasured/reported by: Epoch AI54.4%third-partymeasured/reported by: Epoch AI—————————————————————————————
Grok 4.6xAI · not statednot stated———————————————————————————————————————————————————————————————————————————157.79third-partymeasured/reported by: Epoch AI————————————————————————————
Grok 4.6xAI · High (default)Highdefault20.3%officialmeasured/reported by: xAI——————40.4%officialmeasured/reported by: xAI65.2%officialmeasured/reported by: xAI———1,546officialmeasured/reported by: xAI———————————————————————————48.5%officialmeasured/reported by: xAI———————————15.8%officialmeasured/reported by: xAI————————53.0%officialmeasured/reported by: xAI——————94.0%third-partymeasured/reported by: Epoch AI——97.8%third-partymeasured/reported by: Epoch AI49.3%third-partymeasured/reported by: Epoch AI33.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Grok 4.6xAI · XhighXhigh————————————————————————————————————————————————————————————————————93.2%third-partymeasured/reported by: Epoch AI66.0%third-partymeasured/reported by: Epoch AI31.7%third-partymeasured/reported by: Epoch AI99.2%third-partymeasured/reported by: Epoch AI48.9%third-partymeasured/reported by: Epoch AI33.0%third-partymeasured/reported by: Epoch AI41.1%third-partymeasured/reported by: Epoch AI—————————————————————————————
Grok 4.5xAI · High (default)Highdefault—————————————————————————————————————————————————————————————————————————————————————————————————————47.9%third-partymeasured/reported by: Sierra——
DeepSeek-V4-Pro-0813DeepSeek · not statednot stated———————————————————————————————————————————————————————————————————————————155.94third-partymeasured/reported by: Epoch AI————————————————————————————
DeepSeek-V4-Pro-0813DeepSeek · MaxMax————————————————————————————————————————————————————————————————————91.7%third-partymeasured/reported by: Epoch AI64.6%third-partymeasured/reported by: Epoch AI26.8%third-partymeasured/reported by: Epoch AI98.6%third-partymeasured/reported by: Epoch AI52.9%third-partymeasured/reported by: Epoch AI46.0%third-partymeasured/reported by: Epoch AI33.3%third-partymeasured/reported by: Epoch AI—————————————————————————————
DeepSeek-V4.1-Flash-1017DeepSeek · not statednot stated42.3%officialmeasured/reported by: DeepSeek———————77.0%officialmeasured/reported by: DeepSeek——————————————————————————————————————————————————————————————————159.41third-partymeasured/reported by: Epoch AI————————————————————————————
DeepSeek-V4.1-Flash-1017DeepSeek · MaxMax————————————————————————————————————————————————————————————————————93.2%third-partymeasured/reported by: Epoch AI71.2%third-partymeasured/reported by: Epoch AI46.3%third-partymeasured/reported by: Epoch AI99.4%third-partymeasured/reported by: Epoch AI42.5%third-partymeasured/reported by: Epoch AI46.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
DeepSeek-V4.1-FlashDeepSeek · not statednot stated31.2%officialmeasured/reported by: DeepSeek30.0%officialmeasured/reported by: DeepSeek90.6%officialmeasured/reported by: DeepSeek—————74.2%officialmeasured/reported by: DeepSeek———————————————31.8%officialmeasured/reported by: DeepSeek—78.9%officialmeasured/reported by: DeepSeek———————————————————————62.8%officialmeasured/reported by: DeepSeek—————————————————89.8%third-partymeasured/reported by: Epoch AI67.4%third-partymeasured/reported by: Epoch AI26.8%third-partymeasured/reported by: Epoch AI98.3%third-partymeasured/reported by: Epoch AI42.9%third-partymeasured/reported by: Epoch AI48.0%third-partymeasured/reported by: Epoch AI64.4%third-partymeasured/reported by: Epoch AI156.7third-partymeasured/reported by: Epoch AI—————20.3%officialmeasured/reported by: DeepSeek64officialmeasured/reported by: DeepSeek—54.8%officialmeasured/reported by: DeepSeek—————————89.6%officialmeasured/reported by: DeepSeek49.0%officialmeasured/reported by: DeepSeek————————
GLM-5.3Z.ai · not statednot stated—28.3%officialmeasured/reported by: Z.ai88.2%officialmeasured/reported by: Z.ai—————66.9%officialmeasured/reported by: Z.ai———————62.5%officialmeasured/reported by: Z.ai————————28.5%officialmeasured/reported by: Z.ai————————————————————————————————————84.5%officialmeasured/reported by: Z.ai54.4%officialmeasured/reported by: Z.ai———————————157.1third-partymeasured/reported by: Epoch AI——————58officialmeasured/reported by: Z.ai—48.2%officialmeasured/reported by: Z.ai———————————————————
GLM-5.3Z.ai · Max (default)Maxdefault——————————————————————————————————————————————————————39.8%officialmeasured/reported by: Z.ai—————————————90.9%third-partymeasured/reported by: Epoch AI68.8%third-partymeasured/reported by: Epoch AI29.3%third-partymeasured/reported by: Epoch AI91.1%third-partymeasured/reported by: Epoch AI41.0%third-partymeasured/reported by: Epoch AI37.0%third-partymeasured/reported by: Epoch AI—————42.5%officialmeasured/reported by: Z.ai————————————————————————
GLM-5.3-FlashZ.ai · not statednot stated————————63.4%officialmeasured/reported by: Z.ai——————————————————————————————————————————————————————————————————153.82third-partymeasured/reported by: Epoch AI————————48.8%officialmeasured/reported by: Z.ai———————————————————
GLM-5.3-FlashZ.ai · Max (default)Maxdefault————————————————————————————————————————————————————————————————————90.2%third-partymeasured/reported by: Epoch AI55.8%third-partymeasured/reported by: Epoch AI17.1%third-partymeasured/reported by: Epoch AI93.9%third-partymeasured/reported by: Epoch AI—21.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
GLM-5.2Z.ai · not statednot stated—————————————————————————————————————————————————————————————————————————————————————————————————————37.1%third-partymeasured/reported by: Sierra——
GLM-5Z.ai · not statednot stated————————————————————————————————————————————————————————————————————————————————————————————————————82.5%third-partymeasured/reported by: Sierra9.8%third-partymeasured/reported by: Sierra73.7%third-partymeasured/reported by: Sierra86.8%third-partymeasured/reported by: Sierra
Kimi K3.1 ProMoonshot AI · not statednot stated———————————————————————————————————————————————————————————————————————————161.37third-partymeasured/reported by: Epoch AI————————————————————————————
Kimi K3.1 ProMoonshot AI · Max (default)Maxdefault65.7%officialmeasured/reported by: Moonshot AI——38.1%officialmeasured/reported by: Moonshot AI————75.5%officialmeasured/reported by: Moonshot AI—————————————————90.2%officialmeasured/reported by: Moonshot AI————92.7officialmeasured/reported by: Moonshot AI72.8officialmeasured/reported by: Moonshot AI————————————————20.7%officialmeasured/reported by: Moonshot AI———————34.6%officialmeasured/reported by: Moonshot AI89.0%officialmeasured/reported by: Moonshot AI—————64.4officialmeasured/reported by: Moonshot AI58.6officialmeasured/reported by: Moonshot AI——94.2%third-partymeasured/reported by: Epoch AI78.3%third-partymeasured/reported by: Epoch AI65.9%third-partymeasured/reported by: Epoch AI100.0%third-partymeasured/reported by: Epoch AI62.2%third-partymeasured/reported by: Epoch AI45.0%third-partymeasured/reported by: Epoch AI—————51.7%officialmeasured/reported by: Moonshot AI—31.5%officialmeasured/reported by: Moonshot AI————92.1%officialmeasured/reported by: Moonshot AI——93.4%officialmeasured/reported by: Moonshot AI84.1%officialmeasured/reported by: Moonshot AI90.0%officialmeasured/reported by: Moonshot AI——95.4%officialmeasured/reported by: Moonshot AI63.0%officialmeasured/reported by: Moonshot AI67.4officialmeasured/reported by: Moonshot AI——36.5%officialmeasured/reported by: Moonshot AI————
Kimi K3Moonshot AI · not statednot stated———————————————————————————————————————————————————————————————————————————158.58third-partymeasured/reported by: Epoch AI————————————————————————————
Kimi K3Moonshot AI · LowLow————————————————————————————————————————————————————————————————————84.9%third-partymeasured/reported by: Epoch AI——68.9%third-partymeasured/reported by: Epoch AI—18.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Kimi K3Moonshot AI · HighHigh————————————————————————————————————————————————————————————————————91.9%third-partymeasured/reported by: Epoch AI——93.3%third-partymeasured/reported by: Epoch AI—37.0%third-partymeasured/reported by: Epoch AI——————————————————————————————
Kimi K3Moonshot AI · Max (default)Maxdefault——88.3%officialmeasured/reported by: Moonshot AI—————67.5%officialmeasured/reported by: Moonshot AI—————————————————————————————————————————————36.6%officialmeasured/reported by: Moonshot AI———84.8%officialmeasured/reported by: Moonshot AI—————————93.1%third-partymeasured/reported by: Epoch AI72.2%third-partymeasured/reported by: Epoch AI39.0%third-partymeasured/reported by: Epoch AI97.2%third-partymeasured/reported by: Epoch AI50.6%third-partymeasured/reported by: Epoch AI36.0%third-partymeasured/reported by: Epoch AI54.4%third-partymeasured/reported by: Epoch AI—————42.0%officialmeasured/reported by: Moonshot AI——48.3%officialmeasured/reported by: Moonshot AI—30.8%officialmeasured/reported by: Moonshot AI91.2%officialmeasured/reported by: Moonshot AI84.2%officialmeasured/reported by: Moonshot AI—91.3%officialmeasured/reported by: Moonshot AI81.6%officialmeasured/reported by: Moonshot AI83.4%officialmeasured/reported by: Moonshot AI94.3%officialmeasured/reported by: Moonshot AI97.8%officialmeasured/reported by: Moonshot AI85.7%officialmeasured/reported by: Moonshot AI41.0%officialmeasured/reported by: Moonshot AI63.3officialmeasured/reported by: Moonshot AI————37.1%third-partymeasured/reported by: Sierra——
Mistral Large 4Mistral AI · not statednot stated28.3%officialmeasured/reported by: Mistral AI———————61.7%officialmeasured/reported by: Mistral AI————1,393officialmeasured/reported by: Mistral AI—59.9%officialmeasured/reported by: Mistral AI——————————————————————————————————————————————————59.4%officialmeasured/reported by: Mistral AI93.0%officialmeasured/reported by: Mistral AI———————152.69third-partymeasured/reported by: Epoch AI————————————————————————————
Mistral Large 4Mistral AI · HighHigh————————————————————————————————————————————————————————————————————88.1%third-partymeasured/reported by: Epoch AI58.6%third-partymeasured/reported by: Epoch AI26.8%third-partymeasured/reported by: Epoch AI98.3%third-partymeasured/reported by: Epoch AI20.0%third-partymeasured/reported by: Epoch AI33.0%third-partymeasured/reported by: Epoch AI27.8%third-partymeasured/reported by: Epoch AI—————————————————————————————
Qwen3.8-MaxAlibaba(Qwen) · not statednot stated——86.6%officialmeasured/reported by: Alibaba (Qwen)—————56.6%officialmeasured/reported by: Alibaba (Qwen)——————————————————————————————————————————————————————————————————157.59third-partymeasured/reported by: Epoch AI——67.7%officialmeasured/reported by: Alibaba (Qwen)———55.9officialmeasured/reported by: Alibaba (Qwen)41.0%officialmeasured/reported by: Alibaba (Qwen)—27.3%officialmeasured/reported by: Alibaba (Qwen)——————————————————
Qwen3.8-MaxAlibaba(Qwen) · Xhigh (default)Xhighdefault————————————————————————————————————————————————————————————————————92.7%third-partymeasured/reported by: Epoch AI74.7%third-partymeasured/reported by: Epoch AI46.3%third-partymeasured/reported by: Epoch AI99.4%third-partymeasured/reported by: Epoch AI45.8%third-partymeasured/reported by: Epoch AI46.0%third-partymeasured/reported by: Epoch AI52.2%third-partymeasured/reported by: Epoch AI——————————————————————————55.2%third-partymeasured/reported by: Sierra——
Qwen3.8-27BAlibaba(Qwen) · not statednot stated————————42.2%officialmeasured/reported by: Alibaba (Qwen)—————————————————————————————————————————————————————————————————————61.7%officialmeasured/reported by: Alibaba (Qwen)———42.3officialmeasured/reported by: Alibaba (Qwen)—————————90.0%officialmeasured/reported by: Alibaba (Qwen)94.6%officialmeasured/reported by: Alibaba (Qwen)——————————
Qwen3.5-397B-A17BAlibaba(Qwen) · not statednot stated————————————————————————————————————————————————————————————————————————————————————————————————————81.5%third-partymeasured/reported by: Sierra9.8%third-partymeasured/reported by: Sierra84.4%third-partymeasured/reported by: Sierra97.8%third-partymeasured/reported by: Sierra

Benchmark columns

Terminal-Bench 4.0
Agentic coding. Measures whether an agent can complete complex, multi-step professional tasks in a CLI environment (v4.0). Sorting uses values from “Accuracy vs Cost figure announced by Anthropic (Opus 5.5 and Sonnet 5.5 pages)”.
Terminal-Bench 3.0
Agentic coding. Version 3.0 of Terminal-Bench. Sorting uses values from “Gemini 3.7 Flash model card”.
Terminal-Bench 2.1
Agentic coding. Version 2.1 of Terminal-Bench. Sorting uses values from “Gemini 3.7 Flash model card”.
Terminal-Bench-Science 0.1
Agentic coding. An evaluation of agentic scientific research tasks performed in a terminal (v0.1). Sorting uses values from “Introducing Claude Fable 5.2 and Claude Mythos 5.2”.
FrontierCode v1.1(main set)
Agentic coding. Evaluates whether an agent's code changes are merged by OSS maintainers (v1.1, main set). Sorting uses values from “Accuracy vs Cost figure announced by Anthropic (Opus 5.5 and Sonnet 5.5 pages)”.
FrontierCode 2.0
Agentic coding. Evaluates whether an agent can write code changes that OSS repository maintainers merge (v2.0).
FrontierSWE 2
Agentic coding. Proximal's challenging software engineering agent evaluation (v2). Sorting uses values from “Introducing Claude Fable 5.2 and Claude Mythos 5.2”.
CursorBench 4.0
Agentic coding. Evaluates coding agents on ambiguous multi-file tasks drawn from real Cursor sessions (v4.0). Sorting uses values from “Introducing Claude Opus 5.5”.
DeepSWE v1.1
Agentic coding. Success rate on long-term software engineering tasks (v1.1). Sorting uses values from “Grok 4.7 (xAI news)”.
SWE-sweep
Agentic coding. Subtask-weighted reward on long-term software modification tasks.
GDPval-AA v2.1
Knowledge. Artificial Analysis agent evaluation on practical tasks across 44 occupations (Elo, v2.1). Sorting uses values from “Introducing Claude Opus 5.5”.
GDPval-AA v2
Knowledge. Artificial Analysis evaluation of intellectual work tasks (Elo, v2).
AA-Briefcase v1.1(Elo)
Knowledge. Artificial Analysis evaluation of long-term knowledge work (Elo, v1.1). Sorting uses values from “Introducing Claude Sonnet 5.5”.
AA-Briefcase (Elo, version not stated)
Knowledge. Artificial Analysis evaluation of long-term knowledge work (Elo). Kept separate from v1.1 because the version is not stated in the source.
AA-Briefcase v1.1(rubric)
Knowledge. AA-Briefcase v1.1 rubric score.
AutomationBench
Tool use. Created by Zapier. Measures whether business workflows can be carried out across numerous integrated apps. Sorting uses values from “Introducing Claude Opus 5.5”.
Humanity's Last Exam (with tools)
Reasoning. Expert-level academic knowledge and reasoning test (with tools). Sorting uses values from “Introducing Claude Fable 5.2 and Claude Mythos 5.2”.
Humanity's Last Exam (without tools)
Reasoning. Expert-level academic knowledge and reasoning test (without tools). Sorting uses values from “Introducing Claude Haiku 5.5”.
HLE-Verified
Reasoning. Verified subset of Humanity's Last Exam. Sorting uses values from “Gemini 3.7 Flash model card”.
OSWorld 2.1(partial)
Computer use. Measures whether an agent can complete long, multi-step tasks through real computer use (v2.1, partial credit). Sorting uses values from “Introducing Claude Sonnet 5.5”.
OSWorld 2.1(offline subset)
Computer use. Offline subset of OSWorld 2.1 (as labeled on the Claude Haiku 5.5 announcement page).
OSWorld 2.1 (offline set, partial)
Computer use. Partial score on the OSWorld 2.1 offline set (82 tasks). Sorting uses values from “Introducing Claude Fable 5.2 and Claude Mythos 5.2”.
OSWorld 2.0
Computer use. Partial score on OSWorld 2.0. Sorting uses values from “Gemini 3.7 Flash model card”.
Agents' Last Exam v1.1(rubric score)
Computer use. Long-running practical tasks for agents (v1.1, 122 tasks, averaged rubric score).
Agents' Last Exam (pass rate, version not stated)
Computer use. Agents' Last Exam pass rate. Kept separate from v1.1 (rubric score) because the version is not stated in the source. Sorting uses values from “Gemini 3.7 Flash model card”.
Agents' Last Exam (version and metric not stated)
Computer use. Agents' Last Exam. Kept separate from other Agents' Last Exam results because the version and metric are not stated in the source.
Chartography (with tools)
Multimodal. Accuracy in reading charts and figures (with tools). Sorting uses values from “Introducing Claude Opus 5.5”.
Chartography (without tools)
Multimodal. Accuracy in reading charts and figures (without tools). Provided by Surge AI. Sorting uses values from “Introducing Claude Fable 5.2 and Claude Mythos 5.2”.
WANDR
Tool use. Perplexity agent evaluation on large-scale data collection tasks.
WANDR(relaxed score)
Tool use. WANDR relaxed score.
BenchCAD 2.1 (with tools)
Other. Evaluates how closely hardware designs (shapes and circuits) match a reference, with partial credit from 0 to 100 (v2.1, with tools).
BenchCAD (with tools, version not stated)
Other. CAD generation evaluation (with tools). Kept separate from BenchCAD 2.1 because the version is not stated in the source.
BenchCAD (without tools, version not stated)
Other. CAD generation evaluation (without tools). The version is not stated in the source.
CVE Rediscovery
Other. Anthropic internal evaluation. The proportion of public CVEs that can be independently discovered from snapshots taken before fixes.
CyScenarioBench
Other. Cybersecurity scenario evaluation (tasks are specific to each lab).
De novo binder design (24 hours)
Other. De novo protein binder design (24 hours).
RoboDojo Sim
Other. Simulated dual-arm robot control.
Remote Labor Index(RLI)
Knowledge. A metric measuring performance on remote work tasks.
HealthBench Professional (length-adjusted score)
Knowledge. OpenAI medical conversation evaluation (for experts). Length-adjusted score. Sorting uses values from “Claude Fable 5.2 and Claude Mythos 5.2 System Card”.
HealthBench Hard (length-adjusted score)
Knowledge. Hard subset of OpenAI's medical conversation evaluation. Length-adjusted score. Sorting uses values from “GPT-6 Astra System Card (Table 6. HealthBench Evaluations)”.
HealthBench Professional
Knowledge. Task evaluation for medical professionals. Whether length adjustment was used is not stated in the source.
Artificial Analysis Intelligence Index v5.0
Other. Artificial Analysis composite index combining multiple evaluations (v5.0, with tools).
Vals Index v2.2
Other. Vals AI composite index (v2.2).
Vending-Bench 2
Other. Vending machine management simulation. The score is the final balance (USD).
Blueprint-Bench 2
Multimodal. Similarity score for understanding drawings.
GraphWalks BFS (256k to 1M)
Long context. Graph traversal in a context of 256k to 1M tokens (BFS, F1).
GraphWalks BFS (128k or less)
Long context. Graph traversal in a context of up to 128k tokens (BFS, F1).
RiemannBench
Math. Surge research mathematics benchmark.
CWE-bench v1
Coding. Vulnerability patching (programmatic pass@1, v1).
ExploitGym
Other. Success rate for exploiting vulnerabilities. Sorting uses values from “Gemini 4 Carbon (Google DeepMind models page, benchmark table)”.
SEC-bench Pro
Other. The pass@1 for vulnerability discovery (creating a PoC). Sorting uses values from “Gemini 4 Carbon (Google DeepMind models page, benchmark table)”.
Vals Finance Agent v2
Tool use. Agent evaluation on financial analyst work (v2). Sorting uses values from “Gemini 4 Argon model card”.
Harvey Legal Agent Benchmark
Tool use. The all-pass rate on legal agent work. Sorting uses values from “Grok 4.7 (xAI news)”.
Vibe Code Bench
Coding. Evaluation of app generation (vibe coding).
PostTrainBench
Other. Practical engineering evaluation of ML post-training. This covers results whose version is not stated in the source (v1.2 is kept separate as posttrainbench-1-2). Sorting uses values from “Gemini 4 Argon model card”.
LABBench 2
Knowledge. Evaluation of biology research tasks. Sorting uses values from “Gemini 3.7 Flash model card”.
LVBench
Multimodal. Long-form video understanding. Sorting uses values from “Gemini 3.7 Flash model card”.
GDP.PDF
Knowledge. The all-pass rate on business tasks involving PDFs. Sorting uses values from “Gemini 3.7 Flash model card”.
CharXiv Reasoning
Multimodal. Reasoning about paper figures and tables (without tools). Sorting uses values from “Gemini 3.5 Flash model card”.
BioMysteryBench(Human Solvable)
Knowledge. Biology mystery tasks (group solvable by humans). Sorting uses values from “Gemini 3.7 Flash model card”.
BioMysteryBench(Human Difficult)
Knowledge. Biology mystery tasks (group difficult even for humans). Sorting uses values from “Gemini 3.7 Flash model card”.
EEBench
Other. Evaluation used in an xAI announcement (details not stated in the source).
CyberGym
Other. Cybersecurity evaluation of vulnerability reproduction. Sorting uses values from “Introducing Claude Opus 4.7”.
ExploitBench
Other. Evaluation of exploit creation.
OfficeQA Pro v2
Knowledge. QA evaluation of office documents (v2).
Frontier Finance
Knowledge. Evaluation of practical finance work.
SWE-Atlas-QnA
Coding. QA for codebase understanding.
Cybench
Other. CTF-style cybersecurity evaluation.
GPQA Diamond
Reasoning. 198 graduate-level science questions with 4 choices each (run by Epoch AI itself).
FrontierMath Tiers 1-3(v2)
Math. Epoch AI's private research-level mathematics problems, Tier 1-3 (v2).
FrontierMath Tier 4(v2)
Math. FrontierMath's most difficult Tier 4 (v2, private).
OTIS Mock AIME 2024-2025
Math. AIME-style mathematics competition problems (run by Epoch AI).
SimpleQA Verified
Knowledge. Short-answer factual knowledge questions (verified version, run by Epoch AI).
Chess Puzzles(Epoch AI)
Reasoning. Chess tactics problems (run by Epoch AI).
MirrorCode
Coding. Coding tasks run by Epoch AI.
Epoch Capabilities Index(ECI)
Other. A capability metric from Epoch AI combining many benchmarks (per model, with efforts combined).
LMArena Text (style control, overall)
Writing. Rating based on human votes in LMArena text head-to-head comparisons (with style control, the site's default display).
LMArena Text Coding (without style control)
Coding. The coding category of LMArena text head-to-head comparisons (without style control).
SWE-Bench Pro
Agentic coding. Resolution rate on agentic software engineering tasks (public set). Task modifications and harness differ by source (stated in conditions). Sorting uses values from “Gemini 3.5 Flash model card”.
SWE-Marathon v1.1
Agentic coding. Long-running software engineering tasks (v1.1). Sorting uses values from “GLM-5.3 (Hugging Face model card, zai-org)”.
SWE-Marathon (version not stated)
Agentic coding. Long-running software engineering tasks. Kept separate from v1.1 because the version is not stated in the source or the evaluation used tasks from before the final version of v1.1.
ProgramBench(Almost Solved)
Agentic coding. Proportion of tasks almost solved (score of at least 95%) in challenges to build programs from scratch. Sorting uses values from “DeepSeek-V4.1-Flash (Hugging Face model card, deepseek-ai)”.
NL2Repo-Bench
Agentic coding. Score on tasks to build an entire repository from natural-language specifications. Sorting uses values from “DeepSeek-V4.1-Flash (Hugging Face model card, deepseek-ai)”.
MLS-Bench-Lite
Agentic coding. Engineering tasks for machine learning research (Lite version). Sorting uses values from “Kimi K3 (Hugging Face model card, moonshotai)”.
AutomationBench v1.0.6
Tool use. Business workflow automation created by Zapier (v1.0.6). Kept separate from automationbench of a different version (Anthropic figure) and the public 600-task version. Sorting uses values from “DeepSeek-V4.1-Flash (Hugging Face model card, deepseek-ai)”.
AutomationBench (600 public tasks)
Tool use. Subset of AutomationBench's 600 public tasks. Sorting uses values from “Kimi K3 (Hugging Face model card, moonshotai)”.
BrowseComp
Tool use. Agent tasks that search the Web for answers. Sorting uses values from “Kimi K3.1 Pro (Hugging Face model card, moonshotai)”.
MCP Atlas
Tool use. Multi-step tool-use workflows using an MCP server. Subsets and graders differ by source (stated in conditions).
OSWorld-Verified
Computer use. Real computer use tasks (verified version). Execution methods differ by source (stated in conditions). Sorting uses values from “Gemini 3.5 Flash model card”.
CharXiv Reasoning (with tools)
Multimodal. Reasoning about paper figures and tables (with tools; Python, search and other tools differ by source). Sorting uses values from “Gemini 3.7 Flash model card”.
MMMU-Pro
Multimodal. Understanding and reasoning about image-based questions across multiple disciplines (without tools). Sorting uses values from “Gemini 3.5 Flash model card”.
MMMU-Pro (with tools)
Multimodal. MMMU-Pro solved with tools such as Python. Sorting uses values from “Kimi K3.1 Pro (Hugging Face model card, moonshotai)”.
MathVision
Math. Mathematics problems involving figures (without tools). Sorting uses values from “Kimi K3 (Hugging Face model card, moonshotai)”.
MathVision (with tools)
Math. Mathematics problems involving figures solved with tools such as code execution. Sorting uses values from “Kimi K3 (Hugging Face model card, moonshotai)”.
BabyVision (with tools)
Multimodal. Basic visual reasoning (with tools). Sorting uses values from “DeepSeek-V4.1-Flash (Hugging Face model card, deepseek-ai)”.
ZeroBench main (with tools, pass@5)
Multimodal. The pass@5 on difficult image reasoning problems (main set), with tools over 5 trial runs. Sorting uses values from “DeepSeek-V4.1-Flash (Hugging Face model card, deepseek-ai)”.
OfficeQA Pro
Knowledge. QA evaluation of office documents (kept separate from v2). Sorting uses values from “Kimi K3.1 Pro (Hugging Face model card, moonshotai)”.
MRCR v2 (8-needle, 128k)
Long context. Evaluation of retrieving multiple pieces of information from a long text (8-needle, average up to 128k). Sorting uses values from “Gemini 3.5 Flash model card”.
MRCR v2 (8-needle, 1M)
Long context. Evaluation of retrieving multiple pieces of information from a long text (8-needle, 1M tokens).
PostTrainBench v1.2
Other. Practical engineering evaluation of ML post-training (v1.2). Kept separate from posttrainbench whose version is not stated.
τ²-bench airline (v1.0.1)
Tool use. Measures whether a conversational agent using tools can interact with a simulator playing the user and complete airline customer service tasks according to policy (pass^1). Submissions with tau2_bench_version v1.0.1 (the user simulator is gpt-5.2, the submission's user_simulator). Airline task fixes were made in 1.0.0 ("Airline task fixes (27 tasks)" in [1.0.0] of the CHANGELOG), but the submission_date of the submissions shown here (2026-02-26 to 03-02) precedes the release of 1.0.0 (2026-03-18), and the submissions do not reveal whether they include the fixes. The v1.0.1 scoring changes apply only to banking_knowledge and do not affect this domain ("Other domains are unaffected" in [1.0.1] of the CHANGELOG).
τ²-bench banking_knowledge (v1.0.1)
Tool use. Measures whether a conversational agent using tools can interact with a simulator playing the user and complete banking customer service tasks that require knowledge base search according to policy (pass^1). Submissions with tau2_bench_version v1.0.1. The banking_knowledge scoring was corrected in v1.0.1, so values cannot be compared with those from versions before 1.0.1 ("banking_knowledge scores are not comparable across this release" in [1.0.1] of the CHANGELOG). Sorting uses values from “τ²-bench v1.0.1 banking_knowledge (run by Sierra, search alltools)”.
τ²-bench retail (v1.0.1)
Tool use. Measures whether a conversational agent using tools can interact with a simulator playing the user and complete retail customer service tasks according to policy (pass^1). Submissions with tau2_bench_version v1.0.1 (the user simulator is gpt-5.2, the submission's user_simulator). Retail task fixes were made in 1.0.0 ("Retail task fixes (26 tasks)" in [1.0.0] of the CHANGELOG), but the submission_date of the submissions shown here (2026-02-26 to 03-02) precedes the release of 1.0.0 (2026-03-18), and the submissions do not reveal whether they include the fixes. The v1.0.1 scoring changes apply only to banking_knowledge and do not affect this domain ("Other domains are unaffected" in [1.0.1] of the CHANGELOG).
τ²-bench telecom (v1.0.1)
Tool use. Measures whether a conversational agent using tools can interact with a simulator playing the user and complete telecom technical support tasks according to policy (dual control, with the user also operating the device) (pass^1). Submissions with tau2_bench_version v1.0.1 (the user simulator is gpt-5.2, the submission's user_simulator). There is no item for telecom task fixes in [1.0.0] of the CHANGELOG. The v1.0.1 scoring changes apply only to banking_knowledge and do not affect this domain ("Other domains are unaffected" in [1.0.1] of the CHANGELOG).