DeepSeek Coder 33B is an open-weights model from DeepSeek and Peking University, released November 2, 2023. It has an ECI score of 96 and ranks 239th of 251 tracked models. At the time of its release, it ranked 24th of 33 tracked models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 96 | 96 | 91 | 104 | |
| Ranking | #239 | #238 | #245 | #228 | |
| Language understanding | WinoGrandeBest score 89% | ||||
| Mathematics | GSM8KBest score 95% | ||||
| Science | ARC AI2Best score 95% | ||||
| World knowledge | MMLUBest score 88% |