DeepSeek-R1
ECI#129
139DeepSeek-R1 is an open-weights model from DeepSeek, released January 20, 2025. It has an ECI score of 139 and ranks 129th of 240 tracked models. At the time of its release, it ranked 2nd of 88 tracked models.
DeepSeek-R1 vs select alternatives
| Domain | Benchmark | DeepSeek-R1 | |||
|---|---|---|---|---|---|
ECI scoreBest score 173 | 139 | 132 | 141 | 133 | |
| Ranking | #129 | #154 | #117 | #149 | |
| Conceptual reasoning | SimpleBenchBest score 95% | ||||
ARC-AGI-1Best score 99% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 97% | ||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 26 min 56 sec | 18 min 28 sec | 38 min 50 sec | 20 min 31 sec |
Aider PolyglotBest score 88% | |||||
WeirdML (v2)Best score 94% | |||||
| Other | LiveBenchBest score 82% |
