Back to models

Claude Opus 4

ECI#96
143
Anthropic
May 22, 2025
Closed weights

Claude Opus 4 is a closed-weights model from Anthropic, released May 22, 2025. It has an ECI score of 143 and ranks 96th of 253 tracked models. At the time of its release, it ranked 4th of 139 tracked models.

Claude Opus 4 vs select alternatives

DomainBenchmark
Claude Opus 4
Anthropic
May 22, 2025
Closed weights
Anthropic
Feb. 24, 2025
Closed weights
OpenAI
Apr. 16, 2025
Closed weights
Google DeepMind
Mar. 31, 2025
Closed weights
ECI scoreBest score 167
143141147144
Ranking#96#108#65#87
Conceptual reasoning
ARC-AGI-2Best score 95%
9%
1%
7%
n/a
ARC-AGI-1Best score 99%
36%
29%
61%
33%
Mathematics
MATH Level 5Best score 98%
85%
91%
98%
96%
OTIS Mock AIME 2024-2025Best score 100%
64%
58%
84%
n/a
Science
Humanity's Last ExamBest score 55%
11%
8%
20%
18%
GPQA DiamondBest score 96%
76%
79%
82%
84%
Software engineering
METR Time HorizonsBest score 17 hr 25 min
1 hr 40 min1 hr2 hr—
SWE-bench VerifiedBest score 83%
71%
61%
62%
n/a
Aider PolyglotBest score 88%
72%
65%
81%
73%

Model metadata