DataAI benchmarks AI daily → explore →

AI benchmarks

95 benchmarks · 9,344 measured scores · 65 labs · 1 lab claims, not independently measured. Updated 1 h ago.

The race: Epoch Capabilities Index

Each line is one lab's best score so far, labelled at its end. The frontier is 169 (GPT-6 Astra, 3 Sep 2026).

Epoch Capabilities Index: each lab's best score over time.17590.4Feb 2023Oct 2026Anthropic 168DeepSeek 159Google 166Meta 162Moonshot 158OpenAI 169

Open weights against closed

The best open-weights model against the best closed one on the same benchmark. The time gap is how long ago the closed frontier first reached today's open-weights best.

LMArena text

as of 28 Oct 2026
LMArena text: closed-weights frontier 1,540, open-weights frontier 1,491.1,5441,487Oct 2026Oct 2026closed 1,540open 1,491

Open trails by 48.7

GPQA diamond

as of 26 Oct 2026
GPQA diamond: closed-weights frontier 96.4%, open-weights frontier 93.2%.97%10%Mar 2023Oct 2026closed 96.4%open 93.2%

Open trails by 3.2 pts, about 8 months behind in time

OTIS Mock AIME 2024-2025

as of 26 Oct 2026
OTIS Mock AIME 2024-2025: closed-weights frontier 100%, open-weights frontier 99.4%.100%0%Mar 2023Oct 2026closed 100%open 99.4%

Open trails by 0.6 pts, about 6 months behind in time

Epoch Capabilities Index

as of 26 Oct 2026
Epoch Capabilities Index: closed-weights frontier 169, open-weights frontier 159.174105Feb 2023Oct 2026closed 169open 159

Open trails by 10.2, about 8 months behind in time

ARC-AGI

as of 17 Oct 2026
ARC-AGI: closed-weights frontier 98.5%, open-weights frontier 94.5%.100%0%Sep 2024Oct 2026closed 98.5%open 94.5%

Open trails by 4.0 pts, about 5 months behind in time

ARC-AGI-2

as of 17 Oct 2026
ARC-AGI-2: closed-weights frontier 95%, open-weights frontier 78.1%.100%0%Jul 2024Oct 2026closed 95%open 78.1%

Open trails by 16.9 pts, about 8 months behind in time

Every benchmark: the best score over time

The line steps up each time a model beats every earlier one; each dot is coloured by the lab that set the record. Hollow diamonds are scores a lab claims that no leaderboard has measured.

LMArena text

as of 28 Oct 2026

1,540 Gemini 4 Carbon (High)

LMArena text: best measured score over time. Now 1,540 by Gemini 4 Carbon (High).1,5411,532Oct 2026Oct 2026Gemini 4 Argon (High): 1,532 (2026-10-15)Gemini 4 Carbon (High): 1,540 (2026-10-28)1,540 Gemini 4 …

GPQA diamond

as of 26 Oct 2026

96.4% Gemini 4 Argon (high)

GPQA diamond: best measured score over time. Now 96.4% by Gemini 4 Argon (high).97%20%Mar 2023Oct 2026GPT-4 (Mar 2023): 35.7% (2023-03-14)GPT-4 Turbo Preview (Nov 2023): 42.4% (2023-11-06)Claude 3 Opus: 47.2% (2024-02-29)GPT-4o (May 2024): 48.9% (2024-05-13)Claude 3.5 Sonnet (Jun 2024): 54% (2024-06-20)o1-mini (high): 62.4% (2024-09-12)o1 (high): 76.8% (2024-12-17)o3-mini (high): 77% (2025-01-31)Claude 3.7 Sonnet (64k thinking): 79.7% (2025-02-24)Gemini 2.5 Pro Exp (Mar 2025): 83.8% (2025-03-25)Gemini 2.5 Pro Preview (Jun 2025): 84.8% (2025-06-05)Gemini 2.5 Pro (Jun 2025): 85.3% (2025-06-17)Grok 4: 87% (2025-07-09)GPT-5.1 (high): 87.6% (2025-11-13)Gemini 3 Pro Preview: 92.6% (2025-11-18)Gemini 3.1 Pro Preview: 94.4% (2026-02-19)GPT-5.4 Pro (xhigh): 94.6% (2026-03-05)Gemini 3.7 Flash (high): 94.8% (2026-08-13)Gemini 3.8 Flash (high): 95.4% (2026-09-02)GPT-6 Astra (max): 95.8% (2026-09-03)Gemini 4 Argon (high): 96.4% (2026-09-30)96.4% Gemini 4 …

99% of the ceiling · +9.4 pts in 12 months · open weights ~8 months behind

OTIS Mock AIME 2024-2025

as of 26 Oct 2026

100% GPT-5.5 Pro (xhigh)

OTIS Mock AIME 2024-2025: best measured score over time. Now 100% by GPT-5.5 Pro (xhigh).100%0%Mar 2023Oct 2026GPT-4 (Mar 2023): 0.6% (2023-03-14)GPT-4 (Jun 2023): 1.1% (2023-06-13)Claude 2: 2.5% (2023-07-11)Claude 3 Opus: 4.7% (2024-02-29)GPT-4 Turbo (Apr 2024): 6.7% (2024-04-09)Gemini 1.5 Pro (May 2024): 6.8% (2024-05-14)GPT-4o mini: 6.9% (2024-07-18)Llama 3.1-405B: 9.7% (2024-07-23)o1-mini (high): 46.9% (2024-09-12)o1 (high): 73.3% (2024-12-17)o3-mini (high): 76.9% (2025-01-31)Grok-3 mini: 77.8% (2025-04-09)o3 (medium): 84.4% (2025-04-16)Gemini 2.5 Pro (Jun 2025): 84.7% (2025-06-17)Qwen3-235B-A22B-Thinking (Jul 2025): 86.7% (2025-07-25)gpt-oss-120b: 88.9% (2025-08-05)GPT-5 (high): 91.4% (2025-08-07)GPT-5.2 (high): 96.1% (2025-12-11)GPT-5.4 (high): 97.8% (2026-03-05)Claude Opus 4.7 (xhigh): 97.8% (2026-04-16)GPT-5.5 Pro (xhigh): 100% (2026-04-23)100% GPT-5.5 Pr…

100% of the ceiling · +8.6 pts in 12 months · open weights ~6 months behind

ARC-AGI

as of 17 Oct 2026

98.5% Claude Fable 5 (xhigh)

ARC-AGI: best measured score over time. Now 98.5% by Claude Fable 5 (xhigh).100%0%Sep 2024Oct 2026o1-preview: 18% (2024-09-12)o1 (medium): 30.7% (2024-12-17)o3-mini (high): 34.5% (2025-01-31)o3 (high): 60.8% (2025-04-16)Grok 4: 66.7% (2025-07-09)GPT-5 Pro: 70.2% (2025-10-07)GPT-5.1 (high): 72.8% (2025-11-13)Gemini 3 Pro Preview: 75% (2025-11-18)Claude Opus 4.5 (64k thinking): 80% (2025-11-24)GPT-5.2 Pro: 90.5% (2025-12-11)Gemini 3.1 Pro Preview: 98% (2026-02-19)Claude Fable 5 (xhigh): 98.5% (2026-06-09)98.5% Claude Fa…

99% of the ceiling · +28.3 pts in 12 months · open weights ~5 months behind

ARC-AGI-2

as of 17 Oct 2026

95% GPT-6 Astra (max)

ARC-AGI-2: best measured score over time. Now 95% by GPT-6 Astra (max).100%0%Jul 2024Oct 2026GPT-4o mini: 0% (2024-07-18)o1-mini (unknown thinking): 0.8% (2024-09-12)DeepSeek-R1: 1.3% (2025-01-20)o3-mini (high): 3% (2025-01-31)o3 (high): 6.5% (2025-04-16)Claude Opus 4: 8.6% (2025-05-22)Grok 4: 16% (2025-07-09)GPT-5 Pro: 18.3% (2025-10-07)Gemini 3 Pro Preview: 31.1% (2025-11-18)Claude Opus 4.5 (64k thinking): 37.6% (2025-11-24)GPT-5.2 Pro: 54.2% (2025-12-11)Claude Opus 4.6 (120k thinking): 64.6% (2026-02-05)Grok 4.20: 65.1% (2026-02-17)Gemini 3.1 Pro Preview: 77.1% (2026-02-19)GPT-5.4 Pro (xhigh): 83.3% (2026-03-05)GPT-5.5 (xhigh): 85% (2026-04-23)Claude Fable 5 (max): 89.2% (2026-06-09)GPT-5.6 Sol (max): 92.5% (2026-07-09)GPT-6 Astra (max): 95% (2026-09-03)95% GPT-6 Astra…

95% of the ceiling · +76.7 pts in 12 months · open weights ~8 months behind

CritPt

as of 28 Oct 2026

36% Gemini 4 Carbon (high)

CritPt: best measured score over time. Now 36% by Gemini 4 Carbon (high).100%0%Jul 2024Oct 2026Llama 3.1-8B: 0% (2024-07-23)DeepSeek-R1: 1.1% (2025-01-20)o3 (high): 1.4% (2025-04-16)Gemini 2.5 Pro (Jun 2025): 2% (2025-06-17)GPT-5 (high): 12.6% (2025-08-07)GPT-5.3 Codex (xhigh): 16.9% (2026-02-05)Gemini 3 Deep Think: 25.7% (2026-02-12)GPT-5.4 Pro (xhigh): 30% (2026-03-05)GPT-5.5 Pro (xhigh): 30.6% (2026-04-23)GPT-5.6 Sol (max): 32.3% (2026-07-09)Gemini 4 Carbon (high): 36% (2026-10-28)36% Gemini 4 Ca…

36% of the ceiling · +23.4 pts in 12 months · open weights ~8 months behind

DTBench

as of 12 Oct 2026

98.9% Claude Opus 5.5 (max)

DTBench: best measured score over time. Now 98.9% by Claude Opus 5.5 (max).100%50%Jun 2023Oct 2026GPT-4 (Jun 2023): 62.7% (2023-06-13)GPT-4o (May 2024): 64.5% (2024-05-13)Claude 3.5 Sonnet (Jun 2024): 67.8% (2024-06-20)Claude 3.5 Sonnet (Oct 2024): 67.8% (2024-10-22)o1 (high): 74.7% (2024-12-17)o3 (high): 84.8% (2025-04-16)o3-pro: 86.9% (2025-06-10)GPT-5 (high): 90.7% (2025-08-07)GPT-5.2 (xhigh): 90.9% (2025-12-11)Claude Opus 4.6 (max): 91.2% (2026-02-05)Gemini 3.1 Pro Preview: 97.1% (2026-02-19)Claude Fable 5 (max): 98.4% (2026-06-09)Claude Opus 5.5 (max): 98.9% (2026-09-22)98.9% Claude Op…

99% of the ceiling · +8.3 pts in 12 months · open weights ~6 months behind

SciCode

as of 28 Oct 2026

66.9% Claude Opus 5.5 (max)

SciCode: best measured score over time. Now 66.9% by Claude Opus 5.5 (max).100%0%Jul 2024Oct 2026Llama 3.1-8B: 13.2% (2024-07-23)Claude 3.5 Haiku (Oct 2024): 27.4% (2024-10-22)DeepSeek-V3: 35.8% (2024-12-26)DeepSeek-R1: 38.3% (2025-01-20)o3-mini (high): 42.8% (2025-01-31)Gemini 2.5 Pro (Jun 2025): 46.3% (2025-06-17)Kimi K2.5: 49% (2026-01-27)Gemini 3.1 Pro Preview: 58.7% (2026-02-19)Claude Fable 5 (max): 61% (2026-06-09)Claude Fable 5.1 (max): 63.1% (2026-09-01)Claude Opus 5.5 (max): 66.9% (2026-09-22)66.9% Claude Op…

67% of the ceiling · +20.6 pts in 12 months · open weights ~1 months behind

LMCA

as of 12 Oct 2026

68.3% Claude Sonnet 5.5 (max)

LMCA: best measured score over time. Now 68.3% by Claude Sonnet 5.5 (max).85%10%Jun 2023Oct 2026GPT-4 (Jun 2023): 17.1% (2023-06-13)Llama 3.3 70B: 17.5% (2024-12-06)o1 (high): 22.3% (2024-12-17)GPT-4.1: 25.6% (2025-04-14)o3 (high): 39.7% (2025-04-16)GPT-5 (high): 40% (2025-08-07)GPT-5.1 (high): 43.9% (2025-11-13)Claude Opus 4.5 (high): 44.5% (2025-11-24)Claude Opus 4.6 (max): 55.8% (2026-02-05)Claude Opus 4.8: 57.5% (2026-05-28)Claude Fable 5 (high): 61.2% (2026-06-09)Claude Opus 5 (xhigh): 64.5% (2026-07-24)Claude Fable 5.1 (unknown): 65.5% (2026-09-01)Claude Opus 5.5 (max): 68.2% (2026-09-22)Claude Sonnet 5.5 (max): 68.3% (2026-09-28)68.3% Claude So…

80% of the ceiling · +28.3 pts in 12 months · open weights ~6 months behind

SWE-bench Verified (agent submissions)

as of 26 Feb 2026

79.2% Claude 4.5 Opus

SWE-bench Verified (agent submissions): best measured score over time. Now 79.2% by Claude 4.5 Opus.100%0%Oct 2023Feb 2026Claude 2: 4.4% (2023-10-10)GPT-4 (1106): 22.4% (2024-04-02)Undisclosed: 25.6% (2024-05-09)GPT-4o: 32.6% (2024-06-12)Undisclosed: 37% (2024-06-17)GPT-4o: 38.4% (2024-06-28)Undisclosed: 38.8% (2024-07-21)Undisclosed: 40.6% (2024-08-20)Undisclosed: 45.2% (2024-08-24)Undisclosed: 45.4% (2024-09-24)Claude 3.5 Sonnet: 49% (2024-10-22)Undisclosed: 50% (2024-10-28)CodeAct v2.1 (claude-3-5-sonnet-20241022): 53% (2024-10-29)Claude 3.5 Sonnet: 54.2% (2024-11-08)Undisclosed: 55% (2024-12-02)Undisclosed: 57% (2024-12-08)Undisclosed: 58.2% (2024-12-13)swe-search: 62.2% (2024-12-21)Undisclosed: 62.8% (2025-01-10)o1-preview: 64.6% (2025-01-17)Undisclosed: 65.4% (2025-03-16)Undisclosed: 65.8% (2025-04-15)Multiple: 70% (2025-04-30)Multiple: 70.4% (2025-05-15)Undisclosed: 70.6% (2025-05-19)Claude 4 Opus: 73.2% (2025-05-22)Multiple: 74.4% (2025-06-03)Multiple: 75.2% (2025-06-12)Claude 4 Sonnet: 76.8% (2025-08-04)Doubao-Seed-Code: 78.8% (2025-09-28)Claude 4.5 Opus: 79.2% (2025-12-05)79.2% Claude 4.…

79% of the ceiling · +0.4 pts in 12 months · open weights ~7 months behind

Its source is not updating: read this as the last known state.

WeirdML

as of 3 Sep 2026

93.6% GPT-6 Astra (pro, max)

WeirdML: best measured score over time. Now 93.6% by GPT-6 Astra (pro, max).100%0%Jun 2023Sep 2026GPT-4 (Jun 2023): 12.4% (2023-06-13)Claude 3 Opus: 19.2% (2024-02-29)Claude 3.5 Sonnet (Jun 2024): 31% (2024-06-20)o1-preview: 47.6% (2024-09-12)o4-mini (high): 52.6% (2025-04-16)o3-pro: 58.2% (2025-06-10)GPT-5 (high): 60.7% (2025-08-07)GPT-5.1 (high): 60.8% (2025-11-13)Gemini 3 Pro Preview: 69.9% (2025-11-18)GPT-5.2 (xhigh): 72.2% (2025-12-11)GPT-5.3 Codex: 79.3% (2026-02-05)GPT-5.5 (xhigh): 84.9% (2026-04-23)Claude Fable 5 (max): 91.9% (2026-06-09)Claude Fable 5.1 (max): 92.9% (2026-09-01)GPT-6 Astra (pro, max): 93.6% (2026-09-03)93.6% GPT-6 Ast…

94% of the ceiling · +32.9 pts in 12 months · open weights ~3 months behind

LMArena vision

as of 19 Oct 2026

1,325 Claude Fable 5 (High)

LMArena vision: best measured score over time. Now 1,325 by Claude Fable 5 (High).1,4311,219Oct 2026Oct 2026Claude Fable 5 (High): 1,325 (2026-10-19)1,325 Claude Fa…

Chess Puzzles

as of 17 Oct 2026

76% GPT-6 Astra (pro, max)

Chess Puzzles: best measured score over time. Now 76% by GPT-6 Astra (pro, max).100%0%Feb 2024Oct 2026Claude 3 Opus: 3% (2024-02-29)GPT-4o (Aug 2024): 6% (2024-08-06)o1 (high): 10% (2024-12-17)o3-mini (high): 15% (2025-01-31)o3 (medium): 37% (2025-04-16)GPT-5 Pro: 48% (2025-10-07)GPT-5.2 Pro: 60% (2025-12-11)GPT-5.5 (xhigh): 63% (2026-04-23)GPT-5.6 Sol (pro, max): 68% (2026-07-09)GPT-6 Astra (pro, max): 76% (2026-09-03)76% GPT-6 Astra…

76% of the ceiling · +28.0 pts in 12 months · open weights ~11 months behind

LMArena web development

as of 28 Oct 2026

1,810 Claude Opus 5.5 (Max)

LMArena web development: best measured score over time. Now 1,810 by Claude Opus 5.5 (Max).1,8101,807Oct 2026Oct 2026Claude Opus 5.5 (Max): 1,807 (2026-10-16)Claude Opus 5.5 (Max): 1,809 (2026-10-27)Claude Opus 5.5 (Max): 1,810 (2026-10-28)1,810 Claude Op…

Mystery Game Puzzles

as of 26 Oct 2026

84% GPT-6 Astra (max)

Mystery Game Puzzles: best measured score over time. Now 84% by GPT-6 Astra (max).100%0%Jun 2023Oct 2026GPT-4 (Jun 2023): 12% (2023-06-13)o3 (high): 29% (2025-04-16)Gemini 3.1 Pro Preview: 34% (2026-02-19)GPT-5.4 (xhigh): 37% (2026-03-05)GPT-5.5 (xhigh): 56% (2026-04-23)GPT-5.6 Sol (max): 58% (2026-07-09)Claude Opus 5 (max): 59% (2026-07-24)GPT-6 Astra (max): 84% (2026-09-03)84% GPT-6 Astra…

84% of the ceiling · +55.0 pts in 12 months · open weights ~6 months behind

MMLU

as of 26 Dec 2024

88.1% GPT-4o (Nov 2024)

MMLU: best measured score over time. Now 88.1% by GPT-4o (Nov 2024).100%10%Aug 2021Dec 2024GPT-J-6B: 25.7% (2021-08-05)Gopher (280B): 60% (2021-12-08)davinci-002: 70% (2022-03-15)GPT-4 (Mar 2023): 86.4% (2023-03-14)Claude 3.5 Sonnet (Jun 2024): 86.5% (2024-06-20)Gemini 1.5 Pro (Sept 2024): 86.9% (2024-09-24)Claude 3.5 Sonnet (Oct 2024): 87.3% (2024-10-22)GPT-4o (Nov 2024): 88.1% (2024-11-20)88.1% GPT-4o (N…

88% of the ceiling · 0.0 pts in 12 months · open weights ~2 months behind

No new results in 674 days.

WebDev Arena

as of 30 Sep 2026

1,820 Claude Opus 5.5 (max)

WebDev Arena: best measured score over time. Now 1,820 by Claude Opus 5.5 (max).1,8681,178Jun 2025Sep 2026Gemini 2.5 Pro (Jun 2025): 1,226 (2025-06-17)Qwen3-Coder-480B-A35B: 1,274 (2025-07-31)Claude Opus 4.1 (unknown thinking): 1,389 (2025-08-05)GPT-5 (medium): 1,420 (2025-08-07)Gemini 3 Pro Preview: 1,439 (2025-11-18)Claude Opus 4.5 (32k thinking): 1,495 (2025-11-24)Claude Opus 4.6 (unknown thinking): 1,556 (2026-02-05)Claude Opus 4.7 (unknown): 1,567 (2026-04-16)Claude Fable 5 (high): 1,628 (2026-06-09)Kimi K3 (max): 1,674 (2026-07-16)Claude Opus 5 (max): 1,687 (2026-07-24)Claude Fable 5.1 (max): 1,758 (2026-09-01)GPT-6 Astra (max): 1,800 (2026-09-03)Claude Opus 5.5 (max): 1,820 (2026-09-22)1,820 Claude Op…

+401 in 12 months

ALE-Bench

as of 26 Oct 2026

2,951 GPT-6 Astra (max)

ALE-Bench: best measured score over time. Now 2,951 by GPT-6 Astra (max).3,16919.0Dec 2024Oct 2026Amazon Nova Lite: 236 (2024-12-03)GPT-4.1: 558 (2025-04-14)o3 (high): 934 (2025-04-16)GPT-5 (high): 1,162 (2025-08-07)GPT-5.1 Codex: 1,245 (2025-11-12)GPT-5.2 (high): 1,294 (2025-12-11)Gemini 3 Flash Preview: 1,367 (2025-12-17)GPT-5.3 Codex (xhigh): 1,655 (2026-02-05)GPT-5.5 (xhigh): 1,943 (2026-04-23)Claude Fable 5 (high): 2,041 (2026-06-09)GPT-5.6 Sol (max): 2,177 (2026-07-09)GPT-6 Astra (max): 2,951 (2026-09-03)2,951 GPT-6 Ast…

+1,789 in 12 months · open weights ~8 months behind

FrontierMath-Tiers-1-3-v2-Private

as of 26 Oct 2026

93.7% GPT-6 Astra (max)

FrontierMath-Tiers-1-3-v2-Private: best measured score over time. Now 93.7% by GPT-6 Astra (max).95%0%Jan 2024Oct 2026GPT-3.5 Turbo (Jan 2024): 0% (2024-01-25)GPT-4 Turbo (Apr 2024): 0.7% (2024-04-09)o1 (high): 14.7% (2024-12-17)o3-mini (high): 18.6% (2025-01-31)o4-mini (high): 36.1% (2025-04-16)GPT-5 (high): 55.4% (2025-08-07)GPT-5 Pro: 55.8% (2025-10-07)GPT-5.2 Pro: 74% (2025-12-11)GPT-5.4 Pro (xhigh): 82.5% (2026-03-05)GPT-5.5 Pro (xhigh): 87.7% (2026-04-23)GPT-5.6 Sol (max): 89.1% (2026-07-09)Claude Fable 5.1 (max): 90.2% (2026-09-01)GPT-6 Astra (max): 93.7% (2026-09-03)93.7% GPT-6 Ast…

99% of the ceiling · +37.9 pts in 12 months · open weights ~7 months behind

MATH level 5

as of 15 Oct 2025

98.1% GPT-5 (high)

MATH level 5: best measured score over time. Now 98.1% by GPT-5 (high).100%10%Jun 2023Oct 2025GPT-4 (Jun 2023): 23% (2023-06-13)GPT-4 Turbo Preview (Nov 2023): 40% (2023-11-06)GPT-4 Turbo (Apr 2024): 46.7% (2024-04-09)GPT-4o (May 2024): 51% (2024-05-13)Claude 3.5 Sonnet (Jun 2024): 51.7% (2024-06-20)GPT-4o mini: 52.6% (2024-07-18)GPT-4o (Aug 2024): 53.3% (2024-08-06)o1-mini (high): 89.2% (2024-09-12)o1 (high): 94.7% (2024-12-17)o3-mini (high): 96.5% (2025-01-31)o4-mini (high): 97.8% (2025-04-16)GPT-5 (high): 98.1% (2025-08-07)98.1% GPT-5 (hi…

98% of the ceiling · 0.0 pts in 12 months · open weights ~1 months behind

No new results in 381 days.

SimpleBench

as of 12 Aug 2026

81.9% Claude Fable 5 (max)

SimpleBench: best measured score over time. Now 81.9% by Claude Fable 5 (max).100%10%Feb 2024Aug 2026Claude 3 Opus: 23.5% (2024-02-29)GPT-4 Turbo (Apr 2024): 25.1% (2024-04-09)Claude 3.5 Sonnet (Jun 2024): 27.5% (2024-06-20)o1-preview: 41.7% (2024-09-12)Claude 3.7 Sonnet (12k thinking): 46.4% (2025-02-24)Gemini 2.5 Pro Exp (Mar 2025): 51.6% (2025-03-25)o3 (high): 53.1% (2025-04-16)Claude Opus 4 : 58.8% (2025-05-22)Gemini 2.5 Pro Preview (Jun 2025): 62.4% (2025-06-05)Gemini 3 Pro Preview: 76.4% (2025-11-18)Gemini 3.1 Pro Preview: 79.6% (2026-02-19)Claude Fable 5 (max): 81.9% (2026-06-09)81.9% Claude Fa…

82% of the ceiling · +19.5 pts in 12 months · open weights ~14 months behind

FrontierMath-2025-02-28-Private

as of 28 May 2026

52.4% GPT-5.5 Pro (high)

FrontierMath-2025-02-28-Private: best measured score over time. Now 52.4% by GPT-5.5 Pro (high).57%0%Jun 2024May 2026Claude 3.5 Sonnet (Jun 2024): 1% (2024-06-20)o1-mini (medium): 1.7% (2024-09-12)Claude 3.5 Sonnet (Oct 2024): 2.1% (2024-10-22)o1 (high): 9.3% (2024-12-17)o3-mini (high): 12.4% (2025-01-31)o4-mini (high): 24.8% (2025-04-16)Gemini 2.5 Deep Think: 29% (2025-08-01)GPT-5 (high): 32.4% (2025-08-07)Gemini 3 Pro Preview: 37.6% (2025-11-18)GPT-5.2 (xhigh): 40.7% (2025-12-11)GPT-5.4 Pro (xhigh): 50% (2026-03-05)GPT-5.5 Pro (high): 52.4% (2026-04-23)52.4% GPT-5.5 P…

92% of the ceiling · +20.0 pts in 12 months · open weights ~4 months behind

ForecastBench

as of 13 Aug 2026

67.0 GPT-5.5 (high)

ForecastBench: best measured score over time. Now 67.0 by GPT-5.5 (high).67.461.1Jun 2023Aug 2026GPT-4 (Jun 2023): 61.5 (2023-06-13)Claude 3 Opus: 62.4 (2024-02-29)GPT-4 Turbo (Apr 2024): 63.2 (2024-04-09)o3-mini (unknown thinking): 63.8 (2025-01-31)Claude 3.7 Sonnet (unknown thinking): 64.0 (2025-02-24)GPT-4.5 Preview (Feb 2025): 64.8 (2025-02-27)Grok 4: 65.0 (2025-07-09)GPT-5 (unknown thinking): 65.3 (2025-08-07)Gemini 3.1 Pro Preview: 65.5 (2026-02-19)GPT-5.5 (high): 67.0 (2026-04-23)67.0 GPT-5.5 (h…

+1.7 in 12 months · open weights ~17 months behind

SimpleQA Verified

as of 26 Oct 2026

76% Gemini 4 Argon (high)

SimpleQA Verified: best measured score over time. Now 76% by Gemini 4 Argon (high).100%0%Feb 2024Oct 2026Claude 3 Opus: 12.6% (2024-02-29)GPT-4o (Aug 2024): 26% (2024-08-06)o1 (high): 41.1% (2024-12-17)o3 (high): 49.4% (2025-04-16)GPT-5 (high): 50.1% (2025-08-07)Gemini 3 Flash Preview: 66.8% (2025-12-17)Gemini 3.1 Pro Preview: 73.5% (2026-02-19)GPT-6 Astra (max): 75.6% (2026-09-03)Gemini 4 Argon (high): 76% (2026-09-30)76% Gemini 4 Ar…

76% of the ceiling · +25.9 pts in 12 months · open weights ~10 months behind

67 more benchmarks

GSM8K

as of 29 Nov 2024

94.5% DeepSeek-Coder-V2 236B

GSM8K: best measured score over time. Now 94.5% by DeepSeek-Coder-V2 236B.100%0%Jun 2020Nov 2024GPT-3 XL (babbage): 0.7% (2020-06-22)davinci-002: 56.8% (2022-03-15)davinci-003: 57.1% (2022-11-28)GPT-4 (Mar 2023): 92% (2023-03-14)DeepSeek-Coder-V2 236B: 94.5% (2024-06-17)94.5% DeepSeek-…

95% of the ceiling · 0.0 pts in 12 months

No new results in 701 days.

SWE-bench Lite (agent submissions)

as of 11 Sep 2025

60.3% Claude 4 Sonnet

SWE-bench Lite (agent submissions): best measured score over time. Now 60.3% by Claude 4 Sonnet.100%0%Oct 2023Sep 2025Claude 2: 3% (2023-10-10)GPT-4 (1106): 18% (2024-04-02)Undisclosed: 20.3% (2024-05-09)GPT-4o & Claude 3 Opus: 26.3% (2024-05-23)GPT-4 (1106): 28.3% (2024-06-04)Undisclosed: 31.3% (2024-06-17)Undisclosed: 33% (2024-06-22)GPT-4o: 38% (2024-06-27)Mixed Models: 43% (2024-07-02)Claude 3.5 Sonnet: 47.3% (2024-11-22)Undisclosed: 48.3% (2024-11-27)Undisclosed: 48.7% (2024-12-08)Undisclosed: 49% (2024-12-20)Undisclosed: 55% (2025-01-14)Multiple: 60% (2025-04-25)Claude 4 Sonnet: 60.3% (2025-06-25)60.3% Claude 4 …

60% of the ceiling · 0.0 pts in 12 months · open weights ~8 months behind

Its source is not updating: read this as the last known state.

CursorBench

as of 17 Oct 2026

57.8% Claude Opus 5.5 (max)

CursorBench: best measured score over time. Now 57.8% by Claude Opus 5.5 (max).100%20%May 2026Oct 2026Composer 2.5: 27.7% (2026-05-18)Claude Sonnet 5 (max): 34.1% (2026-06-30)GPT-5.6 Sol (max): 41.7% (2026-07-09)Claude Opus 5 (max): 46.6% (2026-07-24)Claude Fable 5.1 (max): 51.8% (2026-09-01)Claude Opus 5.5 (max): 57.8% (2026-09-22)57.8% Claude Op…

58% of the ceiling · open weights ~2 months behind

ProofBench

as of 23 Oct 2026

100% Claude Fable 5.1 (max)

ProofBench: best measured score over time. Now 100% by Claude Fable 5.1 (max).100%0%Aug 2025Oct 2026GPT-5 (high): 18% (2025-08-07)Claude Sonnet 4.5 (unknown thinking): 19% (2025-09-29)Gemini 3 Pro Preview: 20% (2025-11-18)Claude Opus 4.5 (unknown thinking): 36% (2025-11-24)Claude Opus 4.6 (max): 50% (2026-02-05)GPT-5.4 (xhigh): 56% (2026-03-05)Claude Opus 4.8: 69% (2026-05-28)Claude Fable 5 (max): 95% (2026-06-09)Claude Opus 5 (max): 99% (2026-07-24)Claude Fable 5.1 (max): 100% (2026-09-01)100% Claude Fab…

100% of the ceiling · +81.0 pts in 12 months · open weights ~1 months behind

Winogrande

as of 26 Dec 2024

89.2% Llama 3.1-405B

Winogrande: best measured score over time. Now 89.2% by Llama 3.1-405B.100%50%Nov 2019Dec 2024GPT-2 (1.5B): 58.3% (2019-11-05)GPT-J-6B: 64.5% (2021-08-05)Megatron-Turing NLG 530B: 73% (2021-10-11)GLaM: 79.2% (2021-12-13)davinci-002: 81.6% (2022-03-15)GPT-4 (Mar 2023): 87.5% (2023-03-14)Claude 3 Opus: 88.5% (2024-02-29)Llama 3.1-405B: 89.2% (2024-07-23)89.2% Llama 3.1…

89% of the ceiling · 0.0 pts in 12 months

No new results in 674 days.

FrontierMath-Tier-4-v2-Private

as of 26 Oct 2026

100% GPT-6.1 Sol (max)

FrontierMath-Tier-4-v2-Private: best measured score over time. Now 100% by GPT-6.1 Sol (max).100%0%Jan 2025Oct 2026o3-mini (high): 0% (2025-01-31)o4-mini (high): 4.9% (2025-04-16)GPT-5 (high): 22% (2025-08-07)GPT-5.2 Pro: 46% (2025-12-11)GPT-5.4 Pro (xhigh): 58.5% (2026-03-05)GPT-5.5 Pro (xhigh): 78% (2026-04-23)Claude Fable 5 (max): 90.2% (2026-06-09)GPT-6 Astra (high): 97.6% (2026-09-03)GPT-6.1 Sol (max): 100% (2026-09-29)100% GPT-6.1 So…

100% of the ceiling · +78.0 pts in 12 months · open weights ~8 months behind

ARC AI2

as of 26 Dec 2024

95.3% Llama 3.1-405B

ARC AI2: best measured score over time. Now 95.3% by Llama 3.1-405B.100%10%Nov 2019Dec 2024GPT-2 (1.5B): 25% (2019-11-05)GPT-J-6B: 36.3% (2021-08-05)InstructGPT 175B: 51.5% (2022-01-27)davinci-002: 85.2% (2022-03-15)Stable Beluga 2: 86.1% (2023-07-20)Claude Instant: 86.3% (2023-08-09)GPT-3.5 Turbo (Nov 2023): 87.4% (2023-11-06)phi-3-medium 14B: 91.6% (2024-04-23)DeepSeek-V2 (MoE-236B, May 2024): 92.2% (2024-05-07)Llama 3.1-405B: 95.3% (2024-07-23)95.3% Llama 3.1…

95% of the ceiling · 0.0 pts in 12 months

No new results in 674 days.

FrontierMath-Tier-4-2025-07-01-Private

as of 28 May 2026

47.9% AI co-mathematician

FrontierMath-Tier-4-2025-07-01-Private: best measured score over time. Now 47.9% by AI co-mathematician.60%0%Jun 2024May 2026Claude 3.5 Sonnet (Jun 2024): 0% (2024-06-20)o3-mini (high): 4.2% (2025-01-31)o4-mini (high): 6.3% (2025-04-16)Gemini 2.5 Deep Think: 10.4% (2025-08-01)GPT-5 (high): 12.5% (2025-08-07)GPT-5 Pro: 14.6% (2025-10-07)Gemini 3 Pro Preview: 18.8% (2025-11-18)GPT-5.2 Pro (web): 31.3% (2025-12-11)GPT-5.4 Pro (web): 37.5% (2026-03-05)GPT-5.5 Pro (xhigh): 39.6% (2026-04-23)AI co-mathematician: 47.9% (2026-05-08)47.9% AI co-mat…

80% of the ceiling · +33.3 pts in 12 months · open weights ~7 months behind

Aider polyglot

as of 1 Dec 2025

88% GPT-5 (high)

Aider polyglot: best measured score over time. Now 88% by GPT-5 (high).100%0%Mar 2024Dec 2025openhands-lm-32b-v0.1: 10.2% (2024-03-26)GPT-4o (Aug 2024): 23.1% (2024-08-06)o1-mini (unknown thinking): 32.9% (2024-09-12)Claude 3.5 Sonnet (Oct 2024): 51.6% (2024-10-22)o1 (high): 61.7% (2024-12-17)Claude 3.7 Sonnet (32k thinking): 64.9% (2025-02-24)Gemini 2.5 Pro Exp (Mar 2025): 72.9% (2025-03-25)o3 (high): 81.3% (2025-04-16)Gemini 2.5 Pro Preview (Jun 2025): 83.1% (2025-06-05)o3-pro: 84.9% (2025-06-10)GPT-5 (high): 88% (2025-08-07)88% GPT-5 (high)

88% of the ceiling · 0.0 pts in 12 months · open weights ~6 months behind

No new results in 334 days.

Vending-Bench 2

as of 28 Oct 2026

16,484 Gemini 4 Carbon (unknown)

Vending-Bench 2: best measured score over time. Now 16,484 by Gemini 4 Carbon (unknown).17,757-699Jun 2025Oct 2026Gemini 2.5 Pro (Jun 2025): 574 (2025-06-17)Claude Sonnet 4.5 (unknown thinking): 3,839 (2025-09-29)Gemini 3 Pro Preview: 5,478 (2025-11-18)Claude Opus 4.6 (unknown thinking): 8,018 (2026-02-05)Claude Opus 4.7 (unknown): 10,937 (2026-04-16)Claude Opus 5 (unknown): 11,182 (2026-07-24)GPT-6 Astra (unknown thinking): 15,515 (2026-09-03)Gemini 4 Carbon (unknown): 16,484 (2026-10-28)16,484 Gemini 4…

+12,645 in 12 months · open weights ~2 months behind

HellaSwag

as of 26 Dec 2024

95.3% GPT-4 (Mar 2023)

HellaSwag: best measured score over time. Now 95.3% by GPT-4 (Mar 2023).100%30%Nov 2019Dec 2024GPT-2 (1.5B): 40% (2019-11-05)GPT-3 XL (babbage): 55.5% (2020-06-22)GPT-J-6B: 66.2% (2021-08-05)Megatron-Turing NLG 530B: 80.2% (2021-10-11)davinci-002: 81.5% (2022-03-15)PaLM (540B): 83.6% (2022-04-04)LLaMA-65B: 84.2% (2023-02-24)GPT-4 (Mar 2023): 95.3% (2023-03-14)95.3% GPT-4 (Ma…

95% of the ceiling · 0.0 pts in 12 months · open weights ~17 months behind

No new results in 674 days.

DeepSWE

as of 3 Sep 2026

74.1% GPT-6 Astra (xhigh)

DeepSWE: best measured score over time. Now 74.1% by GPT-6 Astra (xhigh).100%20%Feb 2026Sep 2026Claude Sonnet 4.6 (high): 29.9% (2026-02-17)GPT-5.4 (xhigh): 51.8% (2026-03-05)GPT-5.5 (xhigh): 67% (2026-04-23)Claude Fable 5 (xhigh): 69.9% (2026-06-09)GPT-5.6 Sol (max): 72.7% (2026-07-09)Claude Opus 5 (max): 73.6% (2026-07-24)Gemini 3.8 Flash (high): 73.8% (2026-09-02)GPT-6 Astra (xhigh): 74.1% (2026-09-03)74.1% GPT-6 Ast…

74% of the ceiling · open weights ~2 months behind

BoolQ

as of 17 Aug 2024

90.9% PaLM 2-L

BoolQ: best measured score over time. Now 90.9% by PaLM 2-L.100%50%Nov 2019Aug 2024GPT-2 (1.5B): 61.8% (2019-11-05)GPT-J-6B: 65.4% (2021-08-05)Megatron-Turing NLG 530B: 78.2% (2021-10-11)Gopher (280B): 79.3% (2021-12-08)davinci-002: 87.7% (2022-03-15)PaLM (540B): 88% (2022-04-04)davinci-003: 88.1% (2022-11-28)PaLM 2-L: 90.9% (2023-05-17)90.9% PaLM 2-L

91% of the ceiling · 0.0 pts in 12 months

No new results in 805 days.

Fiction.LiveBench

as of 27 Jan 2026

97.2% o3-pro

Fiction.LiveBench: best measured score over time. Now 97.2% by o3-pro.100%20%Dec 2024Jan 2026Llama 3.3 70B: 33.3% (2024-12-06)o1 (medium): 83.3% (2024-12-17)o3 (medium): 88.9% (2025-04-16)Gemini 2.5 Pro Preview (Jun 2025): 91.7% (2025-06-05)o3-pro: 97.2% (2025-06-10)97.2% o3-pro

97% of the ceiling · 0.0 pts in 12 months · open weights ~10 months behind

No new results in 277 days.

APEX-Agents

as of 26 Oct 2026

82.4% Gemini 4 Argon (unknown)

APEX-Agents: best measured score over time. Now 82.4% by Gemini 4 Argon (unknown).100%0%Aug 2025Oct 2026gpt-oss-120b: 4.4% (2025-08-05)DeepSeek-V3.2 (Thinking; Novita): 21.3% (2025-12-01)Claude Opus 4.6 (max): 46.3% (2026-02-05)GPT-5.4 (unknown thinking): 52.4% (2026-03-05)GPT-5.5 (unknown thinking): 55.1% (2026-04-23)Claude Fable 5: 63.6% (2026-06-09)Claude Opus 5 (max): 65.8% (2026-07-24)Gemini 3.7 Flash (unknown): 67.8% (2026-08-13)Claude Fable 5.1 (unknown): 68.6% (2026-09-01)Claude Opus 5.5 (max): 73.5% (2026-09-22)Claude Sonnet 5.5 (max): 75.5% (2026-09-28)Gemini 4 Argon (unknown): 82.4% (2026-09-30)82.4% Gemini 4 …

82% of the ceiling · +78.0 pts in 12 months

PIQA

as of 26 Dec 2024

88.7% GPT-4o mini

PIQA: best measured score over time. Now 88.7% by GPT-4o mini.100%60%Nov 2019Dec 2024GPT-2 (1.5B): 70.5% (2019-11-05)GPT-Neo-2.7B: 72.9% (2021-03-30)GPT-J-6B: 75.4% (2021-08-05)Megatron-Turing NLG 530B: 82% (2021-10-11)PaLM (540B): 82.3% (2022-04-04)LLaMA-65B: 82.8% (2023-02-24)Falcon-40B: 83% (2023-03-15)Inflection-1: 84.2% (2023-06-22)Falcon-180B: 84.9% (2023-09-06)GPT-4o mini: 88.7% (2024-07-18)88.7% GPT-4o mi…

89% of the ceiling · 0.0 pts in 12 months

No new results in 674 days.

Terminal Bench

as of 23 Apr 2026

81.8% GPT-5.4 (unknown thinking)

Terminal Bench: best measured score over time. Now 81.8% by GPT-5.4 (unknown thinking).100%0%Jun 2025Apr 2026Gemini 2.5 Pro (Jun 2025): 16.4% (2025-06-17)Grok 4: 23.1% (2025-07-09)Kimi K2 Instruct: 26.7% (2025-07-12)Claude Opus 4.1 (unknown thinking): 34.8% (2025-08-05)GPT-5-codex: 41.3% (2025-09-15)GPT-5.1 Codex Mini: 43.1% (2025-11-12)GPT-5.1 (medium): 47.6% (2025-11-13)Gemini 3 Pro Preview: 56% (2025-11-18)GPT-5.1-Codex-Max: 60.4% (2025-11-19)Claude Opus 4.5 (no thinking): 63.1% (2025-11-24)GPT-5.2 Codex: 66.5% (2025-12-18)Claude Opus 4.6 (no thinking): 69.9% (2026-02-05)GPT-5.4 (unknown thinking): 81.8% (2026-03-05)81.8% GPT-5.4 (…

82% of the ceiling · +40.5 pts in 12 months · open weights ~3 months behind

No new results in 191 days.

GDP.pdf

as of 12 Oct 2026

35% GPT-6.1 Sol (max)

GDP.pdf: best measured score over time. Now 35% by GPT-6.1 Sol (max).100%0%Dec 2025Oct 2026Nova 2.0 Pro Preview (unknown): 2% (2025-12-02)Gemini 3 Flash Preview: 10% (2025-12-17)Claude Sonnet 4.6 (max): 18% (2026-02-17)Claude Opus 4.7 (max): 21% (2026-04-16)GPT-5.5 (xhigh): 26% (2026-04-23)Claude Fable 5 (unknown): 30% (2026-06-09)GPT-5.6 Sol (unknown thinking): 30.7% (2026-07-09)GPT-6 Astra (max): 34.2% (2026-09-03)GPT-6.1 Sol (max): 35% (2026-09-29)35% GPT-6.1 Sol…

35% of the ceiling · open weights ~5 months behind

HLE

as of 7 Oct 2026

54.8% GPT-6 Astra (unknown thinking)

HLE: best measured score over time. Now 54.8% by GPT-6 Astra (unknown thinking).100%0%Sep 2024Oct 2026Gemini 1.5 Pro (Sept 2024): 4.6% (2024-09-24)o1 (unknown thinking): 8% (2024-12-17)Claude 3.7 Sonnet (unknown thinking): 8% (2025-02-24)o1 Pro: 8.1% (2025-03-19)Gemini 2.5 Pro Exp (Mar 2025): 18.2% (2025-03-25)o3 (high): 20.3% (2025-04-16)Gemini 2.5 Pro Preview (Jun 2025): 21.6% (2025-06-05)GPT-5 (high): 25.3% (2025-08-07)GPT-5 Pro: 31.6% (2025-10-07)Gemini 3 Pro Preview: 37.5% (2025-11-18)Gemini 3.1 Pro Preview: 46.4% (2026-02-19)Claude Fable 5.1 (xhigh): 46.5% (2026-09-01)GPT-6 Astra (unknown thinking): 54.8% (2026-09-03)54.8% GPT-6 Ast…

55% of the ceiling · +23.2 pts in 12 months · open weights ~6 months behind

BBH

as of 26 Dec 2024

89.2% Gemini 1.5 Pro (May 2024)

BBH: best measured score over time. Now 89.2% by Gemini 1.5 Pro (May 2024).100%30%Feb 2023Dec 2024LLaMA-65B: 43.5% (2023-02-24)GPT-4 (Jun 2023): 75.1% (2023-06-13)Gemini 1.5 Pro (Feb 2024): 84% (2024-02-15)Gemini 1.5 Pro (May 2024): 89.2% (2024-05-14)89.2% Gemini 1.…

89% of the ceiling · 0.0 pts in 12 months · open weights ~8 months behind

No new results in 674 days.

LiveBench

as of 13 Nov 2025

82.3% Gemini 2.5 Pro Exp (Mar 2025)

LiveBench: best measured score over time. Now 82.3% by Gemini 2.5 Pro Exp (Mar 2025).100%40%Feb 2024Nov 2025Claude 3 Opus: 49.2% (2024-02-29)GPT-4o (Aug 2024): 55.3% (2024-08-06)o1-mini (medium): 57.8% (2024-09-12)Claude 3.5 Sonnet (Oct 2024): 59% (2024-10-22)Gemini 2.0 Flash (Dec 2024): 64.1% (2024-12-06)o1 (high): 75.7% (2024-12-17)o3-mini (high): 75.9% (2025-01-31)Gemini 2.5 Pro Exp (Mar 2025): 82.3% (2025-03-25)82.3% Gemini 2.…

82% of the ceiling · 0.0 pts in 12 months · open weights ~3 months behind

No new results in 352 days.

VideoMME

as of 18 Jun 2025

79.7% video-SALMONN 2+

VideoMME: best measured score over time. Now 79.7% by video-SALMONN 2+.100%30%Aug 2023Jun 2025Qwen-VL-Chat: 41.1% (2023-08-20)GPT-4V: 59.9% (2023-11-06)VideoLLAMA3-7B: 66.2% (2024-01-22)Gemini 1.5 Pro (Feb 2024): 75% (2024-02-15)video-SALMONN 2+: 79.7% (2025-06-18)79.7% video-SAL…

80% of the ceiling · 0.0 pts in 12 months · open weights ~7 months behind

No new results in 500 days.

Lech Mazur Writing

as of 7 Aug 2025

86% GPT-5 (medium)

Lech Mazur Writing: best measured score over time. Now 86% by GPT-5 (medium).100%60%Jul 2024Aug 2025GPT-4o mini: 67.2% (2024-07-18)Mistral Large 2 (Jul 2024): 69% (2024-07-24)Claude 3.5 Sonnet (Oct 2024): 80.3% (2024-10-22)GPT-4o (Nov 2024): 81.8% (2024-11-20)DeepSeek-R1: 83% (2025-01-20)o3 (medium): 83.9% (2025-04-16)o3-pro: 84.4% (2025-06-10)Kimi K2 Instruct: 85.6% (2025-07-12)GPT-5 (medium): 86% (2025-08-07)86% GPT-5 (medi…

86% of the ceiling · 0.0 pts in 12 months

No new results in 450 days.

EnigmaEval

as of 9 Jul 2026

39.3% Claude Fable 5 (high)

EnigmaEval: best measured score over time. Now 39.3% by Claude Fable 5 (high).100%0%Feb 2024Jul 2026Claude 3 Opus: 0.8% (2024-02-29)Claude 3.5 Sonnet (Oct 2024): 0.9% (2024-10-22)o1 (unknown thinking): 5.7% (2024-12-17)o1 Pro: 6.1% (2025-03-19)o3 (medium): 13.1% (2025-04-16)GPT-5 Pro: 18.8% (2025-10-07)Gemini 3.1 Pro Preview: 36.8% (2026-02-19)Claude Fable 5 (high): 39.3% (2026-06-09)39.3% Claude Fa…

39% of the ceiling · +20.5 pts in 12 months · open weights ~14 months behind

FrontierCode

as of 7 Oct 2026

54.6% Claude Opus 5.5 (medium)

FrontierCode: best measured score over time. Now 54.6% by Claude Opus 5.5 (medium).100%10%Feb 2026Oct 2026Claude Opus 4.6 (unknown thinking): 26.6% (2026-02-05)GPT-5.4 mini (unknown thinking): 27% (2026-03-17)Claude Opus 4.7 (unknown): 38.5% (2026-04-16)GPT-5.5 (unknown thinking): 43% (2026-04-23)Claude Opus 4.8: 46.5% (2026-05-28)Claude Fable 5 (unknown): 53.5% (2026-06-09)Claude Opus 5.5 (medium): 54.6% (2026-09-22)54.6% Claude Op…

55% of the ceiling · open weights ~2 months behind

METR Time Horizons

as of 7 Apr 2026

17.4 h Claude Mythos Preview (Early)

METR Time Horizons: best measured score over time. Now 17.4 h by Claude Mythos Preview (Early).18.8 h-84 minNov 2019Apr 2026GPT-2 (1.5B): 0 min (2019-11-05)GPT-4 (Mar 2023): 4 min (2023-03-14)GPT-4 Turbo Preview (Nov 2023): 4 min (2023-11-06)GPT-4 Turbo Preview (January 2024): 5 min (2024-01-25)GPT-4o (May 2024): 7 min (2024-05-13)Claude 3.5 Sonnet (Jun 2024): 11 min (2024-06-20)o1-preview: 20 min (2024-09-12)Claude 3.5 Sonnet (Oct 2024): 21 min (2024-10-22)o1 (medium): 39 min (2024-12-17)Claude 3.7 Sonnet: 60 min (2025-02-24)o3 (unknown thinking): 120 min (2025-04-16)GPT-5 (high): 3.4 h (2025-08-07)Gemini 3 Pro Preview: 3.7 h (2025-11-18)Claude Opus 4.5 (no thinking): 4.9 h (2025-11-24)GPT-5.2 (high): 5.9 h (2025-12-11)Claude Opus 4.6 (unknown thinking): 12.0 h (2026-02-05)Claude Mythos Preview (Early): 17.4 h (2026-04-07)17.4 h Claude M…

+842 in 12 months · open weights ~9 months behind

No new results in 207 days.

GSO-Bench

as of 3 Sep 2026

88.2% Claude Fable 5.1 (unknown)

GSO-Bench: best measured score over time. Now 88.2% by Claude Fable 5.1 (unknown).100%0%Oct 2024Sep 2026Claude 3.5 Sonnet (Oct 2024): 4.6% (2024-10-22)o3 (high): 8.8% (2025-04-16)Claude Sonnet 4.5 (unknown thinking): 14.7% (2025-09-29)Gemini 3 Pro Preview: 18.6% (2025-11-18)Claude Opus 4.5 (no thinking): 26.5% (2025-11-24)GPT-5.2 (high): 27.5% (2025-12-11)Claude Opus 4.6 (high): 41.2% (2026-02-05)Claude Opus 4.7 (high): 44.1% (2026-04-16)Claude Opus 4.8: 47.1% (2026-05-28)Claude Fable 5 (unknown): 78.4% (2026-06-09)Claude Fable 5.1 (unknown): 88.2% (2026-09-01)88.2% Claude Fa…

88% of the ceiling · +73.5 pts in 12 months · open weights ~3 months behind

LMArena search

as of 13 Oct 2026

1,261 gpt-5.6-sol-xhigh

LMArena search: best measured score over time. Now 1,261 by gpt-5.6-sol-xhigh.1,3621,160Oct 2026Oct 2026gpt-5.6-sol-xhigh: 1,261 (2026-10-13)1,261 gpt-5.6-s…

OpenBookQA

as of 23 Apr 2024

88% phi-3-small 7.4B

OpenBookQA: best measured score over time. Now 88% by phi-3-small 7.4B.100%10%Nov 2019Apr 2024GPT-2 (1.5B): 22.4% (2019-11-05)GPT-Neo-2.7B: 23.2% (2021-03-30)GPT-J-6B: 38.2% (2021-08-05)GLaM: 53.4% (2021-12-13)InstructGPT 175B: 57.6% (2022-01-27)LLaMA-65B: 60.2% (2023-02-24)Falcon-180B: 64.2% (2023-09-06)Mistral 7B v0.1: 79.8% (2023-09-27)GPT-3.5 Turbo (Nov 2023): 86% (2023-11-06)phi-3-small 7.4B: 88% (2024-04-23)88% phi-3-small…

88% of the ceiling · 0.0 pts in 12 months

No new results in 921 days.

DeepResearch Bench

as of 28 May 2026

55.3% Claude Opus 4.6 (high)

DeepResearch Bench: best measured score over time. Now 55.3% by Claude Opus 4.6 (high).100%30%Feb 2025May 2026Claude 3.7 Sonnet (2k thinking): 43.6% (2025-02-24)o3 (medium): 45.2% (2025-04-16)Claude Opus 4: 46.8% (2025-05-22)Grok 4: 47.3% (2025-07-09)Claude Opus 4.1: 48.3% (2025-08-05)GPT-5 (low): 49.6% (2025-08-07)Claude Sonnet 4.5 (2k thinking): 52.6% (2025-09-29)Claude Opus 4.5 (high): 54.8% (2025-11-24)Claude Opus 4.6 (high): 55.3% (2026-02-05)55.3% Claude Op…

55% of the ceiling · +2.7 pts in 12 months · open weights ~3 months behind

Balrog

as of 3 Sep 2026

68.3% GPT-6 Astra (max)

Balrog: best measured score over time. Now 68.3% by GPT-6 Astra (max).100%20%May 2024Sep 2026GPT-4o (May 2024): 32.3% (2024-05-13)Claude 3.5 Sonnet (Oct 2024): 32.6% (2024-10-22)DeepSeek-R1: 34.9% (2025-01-20)Gemini 2.5 Pro Exp (Mar 2025): 43.3% (2025-03-25)Grok 4: 43.6% (2025-07-09)Gemini 3 Pro Preview: 58.1% (2025-11-18)GPT-5.6 Sol (max): 60% (2026-07-09)Claude Opus 5 (max): 63.4% (2026-07-24)GPT-6 Astra (max): 68.3% (2026-09-03)68.3% GPT-6 Ast…

68% of the ceiling · +24.7 pts in 12 months

TriviaQA

as of 26 Dec 2024

87.5% Claude 2

TriviaQA: best measured score over time. Now 87.5% by Claude 2.100%50%Dec 2021Dec 2024Gopher (280B): 57.1% (2021-12-08)GLaM: 75.8% (2021-12-13)PaLM (540B): 81.4% (2022-04-04)Claude 1.3: 86.7% (2023-04-18)Claude 2: 87.5% (2023-07-11)87.5% Claude 2

88% of the ceiling · 0.0 pts in 12 months · open weights ~21 months behind

No new results in 674 days.

VPCT

as of 17 Dec 2025

91% Gemini 3 Pro Preview

VPCT: best measured score over time. Now 91% by Gemini 3 Pro Preview.100%20%Jun 2024Dec 2025Claude 3.5 Sonnet (Jun 2024): 33% (2024-06-20)GPT-4o mini: 34% (2024-07-18)GPT-4o (Nov 2024): 40% (2024-11-20)GPT-4.5 Preview (Feb 2025): 45% (2025-02-27)Gemini 2.5 Pro Preview (Mar 2025): 48% (2025-03-31)o4-mini (medium): 57.5% (2025-04-16)GPT-5 (high): 66% (2025-08-07)Gemini 3 Pro Preview: 91% (2025-11-18)91% Gemini 3 Pr…

91% of the ceiling · +25.0 pts in 12 months

No new results in 318 days.

Blueprint-Bench 2

as of 28 Oct 2026

58.6% Gemini 4 Carbon (unknown)

Blueprint-Bench 2: best measured score over time. Now 58.6% by Gemini 4 Carbon (unknown).100%0%Oct 2025Oct 2026Claude Haiku 4.5 (unknown thinking): 0% (2025-10-15)Claude Sonnet 4.6 (unknown thinking): 6.7% (2026-02-17)Gemini 3.1 Pro Preview: 26.5% (2026-02-19)GPT-5.4 (unknown thinking): 27.1% (2026-03-05)GPT-5.5 (unknown thinking): 36.2% (2026-04-23)Claude Fable 5 (unknown): 38.6% (2026-06-09)Claude Fable 5.1 (unknown): 41.9% (2026-09-01)GPT-6 Astra (unknown thinking): 49.7% (2026-09-03)Claude Opus 5.5 (unknown): 51.2% (2026-09-22)Gemini 4 Argon (unknown): 54.4% (2026-09-30)Gemini 4 Carbon (unknown): 58.6% (2026-10-28)58.6% Gemini 4 …

59% of the ceiling · +58.6 pts in 12 months · open weights ~3 months behind

Furniture Assembly

as of 26 Oct 2026

83.3% Claude Opus 5.5 (max)

Furniture Assembly: best measured score over time. Now 83.3% by Claude Opus 5.5 (max).100%20%Nov 2025Oct 2026Claude Opus 4.5 (64k thinking): 28.3% (2025-11-24)GPT-5.2 (xhigh): 38.3% (2025-12-11)GPT-5.5 (xhigh): 44.2% (2026-04-23)GPT-5.6 Sol (max): 56.7% (2026-07-09)Claude Opus 5 (max): 60.8% (2026-07-24)Claude Fable 5.1 (max): 70% (2026-09-01)GPT-6 Astra (max): 80% (2026-09-03)Claude Opus 5.5 (max): 83.3% (2026-09-22)83.3% Claude Op…

83% of the ceiling · open weights ~7 months behind

SWE-Bench verified

as of 16 Jun 2026

83.5% Claude Opus 4.7 (max)

SWE-Bench verified: best measured score over time. Now 83.5% by Claude Opus 4.7 (max).100%20%Nov 2024Jun 2026GPT-4o (Nov 2024): 31% (2024-11-20)Claude 3.7 Sonnet: 61% (2025-02-24)o3 (medium): 62.3% (2025-04-16)Claude Opus 4: 70.7% (2025-05-22)Claude Opus 4.1: 73.3% (2025-08-05)GPT-5 (high): 73.6% (2025-08-07)Claude Opus 4.5 (no thinking): 76.7% (2025-11-24)GPT-5.4 (high): 76.9% (2026-03-05)Claude Opus 4.7 (max): 83.5% (2026-04-16)83.5% Claude Op…

83% of the ceiling · +9.9 pts in 12 months · open weights ~2 months behind

GeoBench

as of 17 Dec 2025

88% Gemini 3 Flash Preview

GeoBench: best measured score over time. Now 88% by Gemini 3 Flash Preview.100%60%Jul 2024Dec 2025GPT-4o mini: 64% (2024-07-18)Gemini 1.5 Flash (Sep 2024): 76% (2024-09-24)o1 (medium): 80% (2024-12-17)Gemini 2.5 Pro Exp (Mar 2025): 81% (2025-03-25)Gemini 3 Pro Preview: 84% (2025-11-18)Gemini 3 Flash Preview: 88% (2025-12-17)88% Gemini 3 Fl…

88% of the ceiling · +7.0 pts in 12 months · open weights ~2 months behind

No new results in 318 days.

MirrorCode

as of 12 Oct 2026

97.8% Claude Sonnet 5.5 (max)

MirrorCode: best measured score over time. Now 97.8% by Claude Sonnet 5.5 (max).100%0%Aug 2025Oct 2026GPT-5 (high): 4.4% (2025-08-07)Claude Opus 4.6 (max): 33.3% (2026-02-05)Claude Opus 4.8: 65.6% (2026-05-28)Claude Opus 5 (max): 87.8% (2026-07-24)Claude Fable 5.1 (max): 93.3% (2026-09-01)Claude Sonnet 5.5 (max): 97.8% (2026-09-28)97.8% Claude So…

98% of the ceiling · +93.3 pts in 12 months · open weights ~2 months behind

Surface Evolver Bench

as of 6 Oct 2026

95% Claude Fable 5 (high)

Surface Evolver Bench: best measured score over time. Now 95% by Claude Fable 5 (high).100%10%Aug 2025Oct 2026gpt-oss-120b: 25% (2025-08-05)Gemma 4 31B IT: 30.6% (2026-04-02)Qwen3.6 35B-A3B: 44.4% (2026-04-14)GPT-5.5 (high): 88.1% (2026-04-23)Claude Fable 5 (high): 95% (2026-06-09)95% Claude Fabl…

95% of the ceiling · +70.0 pts in 12 months · open weights ~1 months behind

EBR-bench

as of 26 Oct 2026

78.1% GPT-6.1 Terra (max)

EBR-bench: best measured score over time. Now 78.1% by GPT-6.1 Terra (max).100%0%Aug 2025Oct 2026Claude Opus 4.1: 7.9% (2025-08-05)GPT-5 (high): 12.7% (2025-08-07)Claude Opus 4.5 (128k thinking): 14.3% (2025-11-24)GPT-5.2 (xhigh): 23% (2025-12-11)GPT-5.4 (xhigh): 25.4% (2026-03-05)GPT-5.5 (xhigh): 34.3% (2026-04-23)Claude Fable 5 (max): 39.5% (2026-06-09)GPT-5.6 Sol (max): 44.8% (2026-07-09)Claude Opus 5 (max): 45.7% (2026-07-24)Claude Fable 5.1 (max): 57.1% (2026-09-01)GPT-6 Astra (max): 76.2% (2026-09-03)GPT-6.1 Terra (max): 78.1% (2026-10-26)78.1% GPT-6.1 T…

78% of the ceiling · +65.4 pts in 12 months · open weights ~10 months behind

LAMBADA

as of 30 Nov 2023

79.8% Falcon-180B

LAMBADA: best measured score over time. Now 79.8% by Falcon-180B.100%70%Oct 2021Nov 2023Megatron-Turing NLG 530B: 76.6% (2021-10-11)Chinchilla: 77.4% (2022-03-29)PaLM (540B): 77.9% (2022-04-04)Inflection-1: 78.5% (2023-06-22)Llama-2-70b-hf: 78.9% (2023-07-18)Falcon-180B: 79.8% (2023-09-06)79.8% Falcon-18…

80% of the ceiling · 0.0 pts in 12 months

No new results in 1066 days.

WeirdML v3

as of 26 Oct 2026

54% GPT-6 Astra (xhigh)

WeirdML v3: best measured score over time. Now 54% by GPT-6 Astra (xhigh).90%0%Nov 2025Oct 2026Claude Opus 4.5 (high): 7.1% (2025-11-24)GPT-5.2 (xhigh): 9.7% (2025-12-11)Claude Fable 5 (xhigh): 27.9% (2026-06-09)Claude Opus 5 (xhigh): 32.5% (2026-07-24)Claude Fable 5.1 (xhigh): 43.5% (2026-09-01)GPT-6 Astra (xhigh): 54% (2026-09-03)54% GPT-6 Astra…

60% of the ceiling · open weights ~4 months behind

SWE-bench Full (agent submissions)

as of 19 Dec 2025

52.6% Claude 4.5 Opus

SWE-bench Full (agent submissions): best measured score over time. Now 52.6% by Claude 4.5 Opus.100%0%Oct 2023Dec 2025Claude 2: 2% (2023-10-10)GPT-4 (1106): 12.5% (2024-04-02)Undisclosed: 13.8% (2024-05-09)GPT-4o: 14.6% (2024-06-15)Undisclosed: 19.3% (2024-06-17)Undisclosed: 19.8% (2024-07-21)Undisclosed: 22.1% (2024-08-20)CodeAct v2.1 (claude-3-5-sonnet-20241022): 29.4% (2024-11-03)Undisclosed: 30% (2025-01-31)Claude 3.7 Sonnet: 33.8% (2025-02-27)Undisclosed: 37.1% (2025-05-22)Undisclosed: 42% (2025-06-05)Multiple: 44.3% (2025-10-27)Claude 4.5 Opus: 52.6% (2025-12-19)52.6% Claude 4.…

53% of the ceiling · +8.4 pts in 12 months

Its source is not updating: read this as the last known state.

GBAEval

as of 24 Jul 2026

79.6% Claude Opus 5 (unknown)

GBAEval: best measured score over time. Now 79.6% by Claude Opus 5 (unknown).100%30%Feb 2026Jul 2026Claude Opus 4.6 (unknown thinking): 44.1% (2026-02-05)Claude Sonnet 4.6 (unknown thinking): 48.8% (2026-02-17)GPT-5.5 (unknown thinking): 53.2% (2026-04-23)Claude Opus 4.8: 70.9% (2026-05-28)Claude Fable 5 (unknown): 74.5% (2026-06-09)Claude Opus 5 (unknown): 79.6% (2026-07-24)79.6% Claude Op…

80% of the ceiling · open weights ~5 months behind

ScienceQA

as of 16 Aug 2024

91.3% Phi-3.5-vision-instruct

ScienceQA: best measured score over time. Now 91.3% by Phi-3.5-vision-instruct.100%70%Jan 2022Aug 2024InstructGPT 175B: 74% (2022-01-27)BLIP-2 (Q-Former): 74.2% (2023-02-06)Gemini 1.0 Pro Vision: 79.7% (2024-01-04)GPT-4o (May 2024): 88.5% (2024-05-13)Phi-3.5-vision-instruct: 91.3% (2024-08-16)91.3% Phi-3.5-v…

91% of the ceiling · 0.0 pts in 12 months

No new results in 806 days.

CL-bench

as of 31 Mar 2026

27.9% GPT-5.4 (xhigh)

CL-bench: best measured score over time. Now 27.9% by GPT-5.4 (xhigh).100%0%Apr 2025Mar 2026o3 (high): 17.8% (2025-04-16)GPT-5.1 (high): 23.7% (2025-11-13)GPT-5.4 (xhigh): 27.9% (2026-03-05)27.9% GPT-5.4 (…

28% of the ceiling · +10.1 pts in 12 months · open weights ~3 months behind

No new results in 214 days.

Cybench

as of 5 Feb 2026

93% Claude Opus 4.6 (unknown thinking)

Cybench: best measured score over time. Now 93% by Claude Opus 4.6 (unknown thinking).100%0%Feb 2024Feb 2026Gemini 1.5 Pro (Feb 2024): 7.5% (2024-02-15)Claude 3 Opus: 10% (2024-02-29)Claude 3.5 Sonnet (Jun 2024): 17.5% (2024-06-20)o3-mini (medium): 22.5% (2025-01-31)Claude Opus 4: 38% (2025-05-22)Grok 4: 43% (2025-07-09)Claude Sonnet 4.5 (unknown thinking): 60% (2025-09-29)Claude Opus 4.5 (unknown thinking): 82% (2025-11-24)Claude Opus 4.6 (unknown thinking): 93% (2026-02-05)93% Claude Opus…

93% of the ceiling · +33.0 pts in 12 months · open weights ~2 months behind

No new results in 268 days.

SWE-bench Multimodal (agent submissions)

as of 17 Nov 2025

36% o3

SWE-bench Multimodal (agent submissions): best measured score over time. Now 36% by o3.100%0%Oct 2024Nov 2025GPT-4o: 12.2% (2024-10-06)Claude 3.5 Sonnet: 25.3% (2025-02-26)Undisclosed: 27.1% (2025-03-11)Undisclosed: 29.6% (2025-03-25)Claude 3.7 Sonnet: 30.6% (2025-04-01)Claude 3.7 Sonnet: 31.3% (2025-05-09)Claude Sonnet 4: 34.4% (2025-05-28)Claude 4 Sonnet: 35.6% (2025-06-11)o3: 36% (2025-07-01)36% o3

36% of the ceiling · 0.0 pts in 12 months

Its source is not updating: read this as the last known state.

FrontierSWE

as of 7 Oct 2026

65.5% GPT-6 Astra (max)

FrontierSWE: best measured score over time. Now 65.5% by GPT-6 Astra (max).100%40%Jun 2026Oct 2026Claude Fable 5 (max): 47% (2026-06-09)Claude Opus 5 (max): 52% (2026-07-24)Claude Fable 5.1 (max): 56.3% (2026-09-01)GPT-6 Astra (max): 65.5% (2026-09-03)65.5% GPT-6 Ast…

66% of the ceiling · open weights ~2 months behind

AlgoTune

as of 5 Mar 2026

2.0 GPT-5.2 (medium)

AlgoTune: best measured score over time. Now 2.0 by GPT-5.2 (medium).2.11.7Jan 2025Mar 2026DeepSeek-R1: 1.7 (2025-01-20)o4-mini (high): 1.7 (2025-04-16)Gemini 3 Pro Preview: 1.8 (2025-11-18)GPT-5.2 (medium): 2.0 (2025-12-11)2.0 GPT-5.2 (me…

+0.3 in 12 months

No new results in 240 days.

Remote Labor Index

as of 30 Sep 2026

21.3% Claude Opus 5.5 (unknown)

Remote Labor Index: best measured score over time. Now 21.3% by Claude Opus 5.5 (unknown).100%0%Jun 2025Sep 2026Gemini 2.5 Pro Preview (Jun 2025): 0.8% (2025-06-05)GPT-5 (unknown thinking): 1.7% (2025-08-07)Claude Sonnet 4.5 (unknown thinking): 2.1% (2025-09-29)Claude Opus 4.5 (unknown thinking): 3.8% (2025-11-24)Claude Opus 4.6 (unknown thinking): 4.2% (2026-02-05)GPT-5.5 (unknown thinking): 6.3% (2026-04-23)Claude Opus 4.8: 8.3% (2026-05-28)Claude Fable 5: 16.1% (2026-06-09)Claude Fable 5.1 (unknown): 17.9% (2026-09-01)GPT-6 Astra (unknown thinking): 20.8% (2026-09-03)Claude Opus 5.5 (unknown): 21.3% (2026-09-22)21.3% Claude Op…

21% of the ceiling · +19.2 pts in 12 months

CL-bench Life

as of 24 Apr 2026

22.2% GPT-5.5 (high)

CL-bench Life: best measured score over time. Now 22.2% by GPT-5.5 (high).100%0%Sep 2025Apr 2026DeepSeek-V3.2-Exp: 9.5% (2025-09-29)GPT-5.1 (high): 17.3% (2025-11-13)GPT-5.4 (xhigh): 21.7% (2026-03-05)GPT-5.5 (high): 22.2% (2026-04-23)22.2% GPT-5.5 (…

22% of the ceiling · +12.7 pts in 12 months · open weights ~5 months behind

No new results in 190 days.

CadEval

as of 16 Apr 2025

74% o3 (medium)

CadEval: best measured score over time. Now 74% by o3 (medium).100%0%Mar 2024Apr 2025Claude 3 Haiku: 12% (2024-03-07)GPT-4o (Aug 2024): 26% (2024-08-06)Gemini 1.5 Pro (Sept 2024): 34% (2024-09-24)Claude 3.5 Sonnet (Oct 2024): 48% (2024-10-22)o1 (medium): 56% (2024-12-17)Gemini 2.5 Pro Preview (Mar 2025): 64% (2025-03-31)o3 (medium): 74% (2025-04-16)74% o3 (medium)

74% of the ceiling · 0.0 pts in 12 months

No new results in 563 days.

FrontierMath-Erdos

as of 30 Sep 2026

4.4% GPT-6.1 Sol (max)

FrontierMath-Erdos: best measured score over time. Now 4.4% by GPT-6.1 Sol (max).100%0%Apr 2026Sep 2026GPT-5.5 (xhigh): 0% (2026-04-23)GPT-6 Astra (max): 2.9% (2026-09-03)GPT-6.1 Sol (max): 4.4% (2026-09-29)4.4% GPT-6.1 So…

4% of the ceiling · open weights ~3 months behind

OSWorld 2.0

as of 24 Jul 2026

31.4% Claude Opus 5 (max)

OSWorld 2.0: best measured score over time. Now 31.4% by Claude Opus 5 (max).100%0%Feb 2026Jul 2026Claude Sonnet 4.6 (medium): 9.3% (2026-02-17)Claude Opus 4.7 (max): 13.9% (2026-04-16)Claude Opus 4.8: 18.5% (2026-05-28)GPT-5.6 Sol (max): 27.3% (2026-07-09)Claude Opus 5 (max): 31.4% (2026-07-24)31.4% Claude Op…

31% of the ceiling · open weights ~2 months behind

The Agent Company

as of 29 Sep 2025

42.9% DeepSeek-V3.2-Exp

The Agent Company: best measured score over time. Now 42.9% by DeepSeek-V3.2-Exp.100%0%Jun 2024Sep 2025Qwen2-72B: 1.1% (2024-06-07)Llama 3.1-405B: 7.4% (2024-07-23)Claude 3.5 Sonnet (Oct 2024): 24% (2024-10-22)Claude 3.7 Sonnet: 26.3% (2025-02-24)Gemini 2.5 Pro Preview (Jun 2025): 30.3% (2025-05-06)Claude Sonnet 4: 33.1% (2025-05-22)Gemini 2.5 Flash (Sep 2025): 41.1% (2025-09-25)DeepSeek-V3.2-Exp: 42.9% (2025-09-29)42.9% DeepSeek-…

43% of the ceiling · 0.0 pts in 12 months

No new results in 397 days.

SWE-bench Multilingual (agent submissions)

as of 20 Feb 2026

72.7% Gemini 3 Flash

SWE-bench Multilingual (agent submissions): best measured score over time. Now 72.7% by Gemini 3 Flash.100%60%Feb 2026Feb 2026Gemini 3 Flash: 72.7% (2026-02-13)72.7% Gemini 3 …

73% of the ceiling

Its source is not updating: read this as the last known state.

PostTrainBench

as of 24 Jul 2026

41.8% Claude Fable 5 (max)

PostTrainBench: best measured score over time. Now 41.8% by Claude Fable 5 (max).100%10%Feb 2026Jul 2026Gemini 3.1 Pro Preview: 22% (2026-02-19)Claude Opus 4.7 (xhigh): 28.6% (2026-04-16)Claude Opus 4.8: 33.8% (2026-05-28)Claude Fable 5 (max): 41.8% (2026-06-09)41.8% Claude Fa…

42% of the ceiling · open weights ~2 months behind

ANLI

as of 23 Apr 2024

58.1% GPT-3.5 Turbo (Nov 2023)

ANLI: best measured score over time. Now 58.1% by GPT-3.5 Turbo (Nov 2023).100%30%Oct 2021Apr 2024Megatron-Turing NLG 530B: 39.6% (2021-10-11)Mistral 7B v0.1: 47.1% (2023-09-27)GPT-3.5 Turbo (Nov 2023): 58.1% (2023-11-06)58.1% GPT-3.5 T…

58% of the ceiling · 0.0 pts in 12 months · open weights ~6 months behind

No new results in 921 days.

GDPval

as of 11 Dec 2025

49.7% GPT-5.2 (none)

GDPval: best measured score over time. Now 49.7% by GPT-5.2 (none).100%0%Nov 2024Dec 2025GPT-4o (Nov 2024): 9.9% (2024-11-20)o3 (medium): 30.8% (2025-04-16)Claude Opus 4.1: 43.6% (2025-08-05)Claude Opus 4.5 (no thinking): 45.5% (2025-11-24)GPT-5.2 (none): 49.7% (2025-12-11)49.7% GPT-5.2 (…

50% of the ceiling · +6.1 pts in 12 months

No new results in 324 days.

ExploitBench

as of 23 Apr 2026

70.6% Claude Mythos Preview (Early)

ExploitBench: best measured score over time. Now 70.6% by Claude Mythos Preview (Early).100%0%Oct 2025Apr 2026Claude Haiku 4.5 (unknown thinking): 13.4% (2025-10-15)Claude Sonnet 4.6 (no thinking): 22.7% (2026-02-17)Claude Mythos Preview (Early): 70.6% (2026-04-07)70.6% Claude My…

71% of the ceiling · +57.2 pts in 12 months · open weights ~2 months behind

No new results in 191 days.

OSWorld

as of 17 Feb 2026

72.1% Claude Sonnet 4.6 (no thinking)

OSWorld: best measured score over time. Now 72.1% by Claude Sonnet 4.6 (no thinking).100%0%Sep 2024Feb 2026Qwen2.5-72B: 4.4% (2024-09-19)Claude 3.7 Sonnet: 27.1% (2025-02-24)Claude Sonnet 4: 31.2% (2025-05-22)Claude Sonnet 4.5 (no thinking): 42.9% (2025-09-29)Claude Opus 4.5 (no thinking): 66.3% (2025-11-24)Claude Sonnet 4.6 (no thinking): 72.1% (2026-02-17)72.1% Claude So…

72% of the ceiling · +29.2 pts in 12 months · open weights ~2 months behind

No new results in 256 days.

SpatialViz-Bench

as of 17 Jun 2025

44.7% Gemini 2.5 Pro (Jun 2025)

SpatialViz-Bench: best measured score over time. Now 44.7% by Gemini 2.5 Pro (Jun 2025).100%20%Jan 2024Jun 2025Qwen-VL-Max: 32% (2024-01-18)Qwen2.5-72B: 33.3% (2024-09-19)o1 (unknown thinking): 41.4% (2024-12-17)Gemini 2.5 Pro (Jun 2025): 44.7% (2025-06-17)44.7% Gemini 2.…

45% of the ceiling · 0.0 pts in 12 months · open weights ~4 months behind

No new results in 501 days.

SpireClimb

as of 29 Sep 2026

25.7% GPT-6 Astra (max)

SpireClimb: best measured score over time. Now 25.7% by GPT-6 Astra (max).100%0%Sep 2026Sep 2026Claude Fable 5.1 (max): 2% (2026-09-01)GPT-6 Astra (max): 25.7% (2026-09-03)25.7% GPT-6 Ast…

26% of the ceiling

SpireClimb (Slay the Spire 1, Ascension 20 Heart)

as of 29 Sep 2026

20% GPT-6.1 Sol (max)

SpireClimb (Slay the Spire 1, Ascension 20 Heart): best measured score over time. Now 20% by GPT-6.1 Sol (max).100%0%Sep 2026Sep 2026Claude Fable 5.1 (max): 0% (2026-09-01)GPT-6 Astra (max): 16.7% (2026-09-03)GPT-6.1 Sol (max): 20% (2026-09-29)20% GPT-6.1 Sol…

20% of the ceiling

SpireClimb (Slay the Spire 2, Ascension 10)

as of 29 Sep 2026

34.7% GPT-6 Astra (max)

SpireClimb (Slay the Spire 2, Ascension 10): best measured score over time. Now 34.7% by GPT-6 Astra (max).100%0%Sep 2026Sep 2026Claude Fable 5.1 (max): 4% (2026-09-01)GPT-6 Astra (max): 34.7% (2026-09-03)34.7% GPT-6 Ast…

35% of the ceiling

MindCube

as of 22 May 2025

46.7% Gemma 3 12B

MindCube: best measured score over time. Now 46.7% by Gemma 3 12B.100%20%Jun 2024May 2025LongVA-7B: 29.5% (2024-06-13)LLaVA-Video-7B-Qwen2: 42% (2024-09-02)mPLUG-Owl3-7B-241101: 44.9% (2024-11-26)Gemma 3 12B: 46.7% (2025-03-12)46.7% Gemma 3 1…

47% of the ceiling · 0.0 pts in 12 months

No new results in 527 days.

Latest scores

One row per benchmark: its current leader. Click a heading to sort. "Of ceiling" is the leader's score as a share of the best achievable score.

LeaderLabWeights
LMArena text1,540Gemini 4 Carbon (High) Googleclosed809n/an/a28 Oct 2026
GPQA diamond96.4%Gemini 4 Argon (high) Googleclosed32699%+9.4 pts26 Oct 2026
OTIS Mock AIME 2024-2025100%GPT-5.5 Pro (xhigh) OpenAIclosed306100%+8.6 pts26 Oct 2026
Epoch Capabilities Index169GPT-6 Astra OpenAIclosed282n/a+18.326 Oct 2026
ARC-AGI98.5%Claude Fable 5 (xhigh) Anthropicclosed27899%+28.3 pts17 Oct 2026
ARC-AGI-295%GPT-6 Astra (max) OpenAIclosed26695%+76.7 pts17 Oct 2026
CritPt36%Gemini 4 Carbon (high) Googleclosed25636%+23.4 pts28 Oct 2026
DTBench98.9%Claude Opus 5.5 (max) Anthropicclosed23399%+8.3 pts12 Oct 2026
SciCode66.9%Claude Opus 5.5 (max) Anthropicclosed22667%+20.6 pts28 Oct 2026
LMCA68.3%Claude Sonnet 5.5 (max) Anthropicclosed19580%+28.3 pts12 Oct 2026
SWE-bench Verified (agent submissions)79.2%Claude 4.5 Opus Anthropicclosed18079%+0.4 pts26 Feb 2026
WeirdML93.6%GPT-6 Astra (pro, max) OpenAIclosed17094%+32.9 pts3 Sep 2026
LMArena vision1,325Claude Fable 5 (High) Anthropicclosed167n/an/a19 Oct 2026
Chess Puzzles76%GPT-6 Astra (pro, max) OpenAIclosed15476%+28.0 pts17 Oct 2026
LMArena web development1,810Claude Opus 5.5 (Max) Anthropicclosed153n/an/a28 Oct 2026
Mystery Game Puzzles84%GPT-6 Astra (max) OpenAIclosed14284%+55.0 pts26 Oct 2026
MMLU88.1%GPT-4o (Nov 2024) OpenAIclosed13588%0.0 pts26 Dec 2024
WebDev Arena1,820Claude Opus 5.5 (max) Anthropicclosed129n/a+40130 Sep 2026
ALE-Bench2,951GPT-6 Astra (max) OpenAIclosed127n/a+1,78926 Oct 2026
FrontierMath-Tiers-1-3-v2-Private93.7%GPT-6 Astra (max) OpenAIclosed12299%+37.9 pts26 Oct 2026
MATH level 598.1%GPT-5 (high) OpenAIclosed10898%0.0 pts15 Oct 2025
SimpleBench81.9%Claude Fable 5 (max) Anthropicclosed10282%+19.5 pts12 Aug 2026
FrontierMath-2025-02-28-Private52.4%GPT-5.5 Pro (high) OpenAIclosed10192%+20.0 pts28 May 2026
ForecastBench67.0GPT-5.5 (high) OpenAIclosed97n/a+1.713 Aug 2026
SimpleQA Verified76%Gemini 4 Argon (high) Googleclosed9376%+25.9 pts26 Oct 2026
GSM8K94.5%DeepSeek-Coder-V2 236B DeepSeekopen8595%0.0 pts29 Nov 2024
SWE-bench Lite (agent submissions)60.3%Claude 4 Sonnet Anthropicclosed8460%0.0 pts11 Sep 2025
ProofBench100%Claude Fable 5.1 (max) Anthropicclosed82100%+81.0 pts23 Oct 2026
CursorBench57.8%Claude Opus 5.5 (max) Anthropicclosed8258%n/a17 Oct 2026
Winogrande89.2%Llama 3.1-405B Metaopen8089%0.0 pts26 Dec 2024
FrontierMath-Tier-4-v2-Private100%GPT-6.1 Sol (max) OpenAIclosed78100%+78.0 pts26 Oct 2026
ARC AI295.3%Llama 3.1-405B Metaopen7695%0.0 pts26 Dec 2024
FrontierMath-Tier-4-2025-07-01-Private47.9%AI co-mathematician Googleclosed7280%+33.3 pts28 May 2026
Vending-Bench 216,484Gemini 4 Carbon (unknown) Googleclosed71n/a+12,64528 Oct 2026
Aider polyglot88%GPT-5 (high) OpenAIclosed7188%0.0 pts1 Dec 2025
HellaSwag95.3%GPT-4 (Mar 2023) OpenAIclosed7095%0.0 pts26 Dec 2024
DeepSWE74.1%GPT-6 Astra (xhigh) OpenAIclosed6974%n/a3 Sep 2026
BoolQ90.9%PaLM 2-L Unknownn/a6591%0.0 pts17 Aug 2024
Fiction.LiveBench97.2%o3-pro OpenAIclosed6197%0.0 pts27 Jan 2026
APEX-Agents82.4%Gemini 4 Argon (unknown) Googleclosed6082%+78.0 pts26 Oct 2026
Terminal Bench81.8%GPT-5.4 (unknown thinking) OpenAIclosed5982%+40.5 pts23 Apr 2026
PIQA88.7%GPT-4o mini OpenAIclosed5989%0.0 pts26 Dec 2024
GDP.pdf35%GPT-6.1 Sol (max) OpenAIclosed5635%n/a12 Oct 2026
HLE54.8%GPT-6 Astra (unknown thinking) OpenAIclosed5155%+23.2 pts7 Oct 2026
VideoMME79.7%video-SALMONN 2+ ByteDancen/a5080%0.0 pts18 Jun 2025
LiveBench82.3%Gemini 2.5 Pro Exp (Mar 2025) Googleclosed5082%0.0 pts13 Nov 2025
BBH89.2%Gemini 1.5 Pro (May 2024) Googleclosed5089%0.0 pts26 Dec 2024
Lech Mazur Writing86%GPT-5 (medium) OpenAIclosed4986%0.0 pts7 Aug 2025
FrontierCode54.6%Claude Opus 5.5 (medium) Anthropicclosed4655%n/a7 Oct 2026
EnigmaEval39.3%Claude Fable 5 (high) Anthropicclosed4639%+20.5 pts9 Jul 2026
METR Time Horizons17.4 hClaude Mythos Preview (Early) Anthropicclosed45n/a+8427 Apr 2026
OpenBookQA88%phi-3-small 7.4B Microsoftopen4288%0.0 pts23 Apr 2024
LMArena search1,261gpt-5.6-sol-xhigh OpenAIclosed42n/an/a13 Oct 2026
GSO-Bench88.2%Claude Fable 5.1 (unknown) Anthropicclosed4288%+73.5 pts3 Sep 2026
DeepResearch Bench55.3%Claude Opus 4.6 (high) Anthropicclosed4155%+2.7 pts28 May 2026
Balrog68.3%GPT-6 Astra (max) OpenAIclosed4068%+24.7 pts3 Sep 2026
VPCT91%Gemini 3 Pro Preview Googleclosed3891%+25.0 pts17 Dec 2025
TriviaQA87.5%Claude 2 Anthropicclosed3888%0.0 pts26 Dec 2024
Furniture Assembly83.3%Claude Opus 5.5 (max) Anthropicclosed3583%n/a26 Oct 2026
Blueprint-Bench 258.6%Gemini 4 Carbon (unknown) Googleclosed3559%+58.6 pts28 Oct 2026
SWE-Bench verified83.5%Claude Opus 4.7 (max) Anthropicclosed3383%+9.9 pts16 Jun 2026
MirrorCode97.8%Claude Sonnet 5.5 (max) Anthropicclosed3198%+93.3 pts12 Oct 2026
GeoBench88%Gemini 3 Flash Preview Googleclosed3188%+7.0 pts17 Dec 2025
Surface Evolver Bench95%Claude Fable 5 (high) Anthropicclosed2995%+70.0 pts6 Oct 2026
EBR-bench78.1%GPT-6.1 Terra (max) OpenAIclosed2878%+65.4 pts26 Oct 2026
LAMBADA79.8%Falcon-180B Technology Innovation Instituteopen2680%0.0 pts30 Nov 2023
WeirdML v354%GPT-6 Astra (xhigh) OpenAIclosed2560%n/a26 Oct 2026
SWE-bench Full (agent submissions)52.6%Claude 4.5 Opus Anthropicclosed2453%+8.4 pts19 Dec 2025
ScienceQA91.3%Phi-3.5-vision-instruct Unknownn/a2391%0.0 pts16 Aug 2024
GBAEval79.6%Claude Opus 5 (unknown) Anthropicclosed2380%n/a24 Jul 2026
SWE-bench Multimodal (agent submissions)36%o3 OpenAIclosed2236%0.0 pts17 Nov 2025
Cybench93%Claude Opus 4.6 (unknown thinking) Anthropicclosed2293%+33.0 pts5 Feb 2026
CL-bench27.9%GPT-5.4 (xhigh) OpenAIclosed2228%+10.1 pts31 Mar 2026
FrontierSWE65.5%GPT-6 Astra (max) OpenAIclosed2166%n/a7 Oct 2026
Remote Labor Index21.3%Claude Opus 5.5 (unknown) Anthropicclosed1821%+19.2 pts30 Sep 2026
AlgoTune2.0GPT-5.2 (medium) OpenAIclosed18n/a+0.35 Mar 2026
CL-bench Life22.2%GPT-5.5 (high) OpenAIclosed1622%+12.7 pts24 Apr 2026
The Agent Company42.9%DeepSeek-V3.2-Exp DeepSeekopen1443%0.0 pts29 Sep 2025
OSWorld 2.031.4%Claude Opus 5 (max) Anthropicclosed1431%n/a24 Jul 2026
FrontierMath-Erdos4.4%GPT-6.1 Sol (max) OpenAIclosed144%n/a30 Sep 2026
CadEval74%o3 (medium) OpenAIclosed1474%0.0 pts16 Apr 2025
SWE-bench Multilingual (agent submissions)72.7%Gemini 3 Flash Googleclosed1373%n/a20 Feb 2026
PostTrainBench41.8%Claude Fable 5 (max) Anthropicclosed1242%n/a24 Jul 2026
GDPval49.7%GPT-5.2 (none) OpenAIclosed1150%+6.1 pts11 Dec 2025
ANLI58.1%GPT-3.5 Turbo (Nov 2023) OpenAIclosed1158%0.0 pts23 Apr 2024
OSWorld72.1%Claude Sonnet 4.6 (no thinking) Anthropicclosed972%+29.2 pts17 Feb 2026
ExploitBench70.6%Claude Mythos Preview (Early) Anthropicclosed971%+57.2 pts23 Apr 2026
SpatialViz-Bench44.7%Gemini 2.5 Pro (Jun 2025) Googleclosed845%0.0 pts17 Jun 2025
SpireClimb (Slay the Spire 2, Ascension 10)34.7%GPT-6 Astra (max) OpenAIclosed735%n/a29 Sep 2026
SpireClimb (Slay the Spire 1, Ascension 20 Heart)20%GPT-6.1 Sol (max) OpenAIclosed720%n/a29 Sep 2026
SpireClimb25.7%GPT-6 Astra (max) OpenAIclosed726%n/a29 Sep 2026
MindCube46.7%Gemma 3 12B Googleopen547%0.0 pts22 May 2025
CSQA257%GPT-3.5 Turbo (June 2023) OpenAIclosed357%0.0 pts18 Jul 2023
SuperGLUE71.8%InstructGPT 175B OpenAIclosed172%0.0 pts27 Jan 2022

Claimed by the labs, not independently measured

Scores found in a lab's own announcement or model card, extracted automatically once a day. They appear days before any leaderboard runs the model and are the lab's word, so they are kept out of every line above.

Sources: Epoch AI Benchmarking Hub (CC BY 4.0, credit Epoch AI); LMArena (CC BY 4.0 dataset (lmarena-ai/leaderboard-dataset on Hugging Face)); SWE-bench leaderboards (public GitHub data; credit SWE-bench). A score is placed by the model's release date (or the leaderboard's publish date for Elo ratings, which we have captured since our first fetch). Machine access: /api/v1/ai-benchmarks.