Back to models

Claude 3.7 Sonnet

ECI#118
141
Anthropic
Feb. 24, 2025
Closed weights

Claude 3.7 Sonnet is a closed-weights model from Anthropic, released February 24, 2025. It has an ECI score of 141 and ranks 118th (tied with 8 other models) of 242 tracked models. At the time of its release, it ranked 1st of 94 tracked models.

Claude 3.7 Sonnet vs select alternatives

DomainBenchmark
Claude 3.7 Sonnet
Anthropic
Feb. 24, 2025
Closed weights
Anthropic
Oct. 22, 2024
Closed weights
OpenAI
Dec. 17, 2024
Closed weights
DeepSeek
Jan. 20, 2025
Open weights
ECI scoreBest score 173
141133141139
Ranking#118#151#118#130
Conceptual reasoning
ARC-AGI-2Best score 96%
1%
n/a
n/a
1%
ARC-AGI-1Best score 99%
29%
n/a
31%
16%
Mathematics
MATH Level 5Best score 98%
91%
57%
95%
93%
OTIS Mock AIME 2024-2025Best score 100%
58%
8%
73%
53%
Science
Humanity's Last ExamBest score 55%
8%
4%
8%
n/a
GPQA DiamondBest score 97%
79%
55%
77%
69%
Software engineering
METR Time HorizonsBest score 17 hr 25 min
1 hr20 min 31 sec38 min 50 sec26 min 56 sec
Aider PolyglotBest score 88%
65%
52%
62%
57%
Other
LiveBenchBest score 82%
76%
59%
76%
72%

Model metadata