DeepSeek Coder 33B is an open-weights model from DeepSeek and Peking University, released November 2, 2023. It has an ECI score of 77 and ranks 230th of 240 tracked models. At the time of its release, it ranked 23rd of 30 tracked models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 173 | 77 | 84 | 69 | 89 | |
| Ranking | #230 | #226 | #236 | #223 | |
| Language understanding | WinoGrandeBest score 89% | ||||
| Mathematics | GSM8KBest score 95% | ||||
| Science | ARC AI2Best score 95% | ||||
| World knowledge | MMLUBest score 88% |