DeepSeek-R1
ECI#116
139DeepSeek-R1 is an open-weights model from DeepSeek, released January 20, 2025. It has an ECI score of 139 and ranks 116th of 249 tracked models. At the time of its release, it ranked 2nd of 105 tracked models. At $0.70/Mtok for input tokens and $2.50/Mtok for output tokens, it is more expensive per token than similarly-capable models.
Input price$0.70 / 1M tokens
Output price$2.50 / 1M tokens
Parameters6.7e11
Training compute3.5e24 FLOP
DeepSeek-R1 vs select alternatives
Reasoning
| Domain | Benchmark | DeepSeek-R1 | |||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 139 | 132 | 142 | 135 | |
| Ranking | #116 | #143 | #98 | #136 | |
| Conceptual reasoning | SimpleBenchBest score 81.9% | ||||
ARC-AGI-1Best score 98.5% | |||||
| Mathematics | MATH Level 5Best score 98.1% | ||||
OTIS Mock AIME 2024-2025Best score 100.0% | |||||
| Science | GPQA DiamondBest score 95.8% | ||||
| Software engineering | METR Time HorizonsBest score 1044.8 | 26.9 | 18.5 | 38.8 | — |
Aider PolyglotBest score 88.0% | |||||
WeirdML (v2)Best score 92.9% | |||||
| Other | LiveBenchBest score 82.3% |
