DeepSeek-V3
ECI#145
132DeepSeek-V3 is an open-weights model from DeepSeek, released December 26, 2024. It has an ECI score of 132 and ranks 145th of 251 tracked models. At the time of its release, it ranked 6th of 102 tracked models.
DeepSeek-V3 vs select alternatives
| Domain | Benchmark | DeepSeek-V3 | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 132 | 125 | 133 | 130 | |
| Ranking | #145 | #178 | #144 | #150 | |
| Conceptual reasoning | SimpleBenchBest score 82% | ||||
BBHBest score 89% | |||||
| Language understanding | HellaSwagBest score 95% | ||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | ARC AI2Best score 95% | ||||
GPQA DiamondBest score 96% | |||||
| Software engineering | Aider PolyglotBest score 88% | ||||
| Other | LiveBenchBest score 82% |
