Claude 3.7 Sonnet is a closed-weights model from Anthropic, released February 24, 2025. It has an ECI score of 141 and ranks 118th (tied with 8 other models) of 242 tracked models. At the time of its release, it ranked 1st of 94 tracked models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 173 | 141 | 133 | 141 | 139 | |
| Ranking | #118 | #151 | #118 | #130 | |
| Conceptual reasoning | ARC-AGI-2Best score 96% | ||||
ARC-AGI-1Best score 99% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | Humanity's Last ExamBest score 55% | ||||
GPQA DiamondBest score 97% | |||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 1 hr | 20 min 31 sec | 38 min 50 sec | 26 min 56 sec |
Aider PolyglotBest score 88% | |||||
| Other | LiveBenchBest score 82% |