DeepSeek-R1 (May 2025)
ECI#107
141DeepSeek-R1 (May 2025) is an open-weights model from DeepSeek, released May 28, 2025. It has an ECI score of 141 and ranks 107th of 253 tracked models. At the time of its release, it ranked 9th of 140 tracked models.
DeepSeek-R1 (May 2025) vs select alternatives
| Domain | Benchmark | DeepSeek-R1 (May 2025) | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 141 | 139 | 142 | 142 | |
| Ranking | #107 | #120 | #105 | #104 | |
| Conceptual reasoning | SimpleBenchBest score 82% | ||||
ARC-AGI-2Best score 95% | |||||
ARC-AGI-1Best score 99% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 96% | ||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 31 min 10 sec | 26 min 56 sec | — | 1 hr 15 min |
Aider PolyglotBest score 88% | |||||
WeirdML (v2)Best score 94% |
