Claude 3.7 Sonnet
ECI#103
141Claude 3.7 Sonnet is a closed-weights model from Anthropic, released February 24, 2025. It has an ECI score of 141 and ranks 103rd of 249 tracked models. At the time of its release, it ranked 2nd of 112 tracked models.
Claude 3.7 Sonnet vs select alternatives
| Domain | Benchmark | Claude 3.7 Sonnet | |||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 141 | 134 | 142 | 139 | |
| Ranking | #103 | #140 | #98 | #116 | |
| Conceptual reasoning | ARC-AGI-2Best score 95% | ||||
ARC-AGI-1Best score 99% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | Humanity's Last ExamBest score 47% | ||||
GPQA DiamondBest score 96% | |||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 1 hr | 20 min 31 sec | 38 min 50 sec | 26 min 56 sec |
Aider PolyglotBest score 88% | |||||
| Other | LiveBenchBest score 82% |
