Claude Sonnet 4
ECI#104
142Claude Sonnet 4 is a closed-weights model from Anthropic, released May 22, 2025. It has an ECI score of 142 and ranks 104th of 253 tracked models. At the time of its release, it ranked 7th of 139 tracked models.
Claude Sonnet 4 vs select alternatives
| Domain | Benchmark | Claude Sonnet 4 | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 142 | 141 | 142 | 141 | |
| Ranking | #104 | #108 | #105 | #107 | |
| Computer use | OS WorldBest score 72% | ||||
| Conceptual reasoning | ARC-AGI-2Best score 95% | ||||
ARC-AGI-1Best score 99% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | Humanity's Last ExamBest score 55% | ||||
GPQA DiamondBest score 96% | |||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 1 hr 15 min | 1 hr | — | 31 min 10 sec |
Aider PolyglotBest score 88% |
