Claude 3.7 Sonnet
ECI#119
141Claude 3.7 Sonnet is a closed-weights model from Anthropic, released February 24, 2025. It has an ECI score of 141 and ranks 119th of 254 tracked models. At the time of its release, it ranked 2nd of 104 tracked models.
Claude 3.7 Sonnet vs select alternatives
| Domain | Benchmark | Claude 3.7 Sonnet | |||
|---|---|---|---|---|---|
ECI scoreBest score 169 | 141 | 133 | 142 | 139 | |
| Ranking | #119 | #152 | #114 | #131 | |
| Conceptual reasoning | ARC-AGI-2Best score 95% | ||||
ARC-AGI-1Best score 99% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | Humanity's Last ExamBest score 55% | ||||
GPQA DiamondBest score 96% | |||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 1 hr | 20 min 31 sec | 38 min 50 sec | 26 min 56 sec |
Aider PolyglotBest score 88% | |||||
| Other | LiveBenchBest score 82% |
