DeepSeek Coder 6.7B is an open-weights model from DeepSeek and Peking University, released November 2, 2023. It has an ECI score of 90 and ranks 250th of 253 tracked models. At the time of its release, it ranked 31st of 33 tracked models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 90 | 92 | 96 | 105 | |
| Ranking | #250 | #247 | #240 | #230 | |
| Language understanding | WinoGrandeBest score 89% | ||||
| Mathematics | GSM8KBest score 95% | ||||
| Science | ARC AI2Best score 95% | ||||
| World knowledge | MMLUBest score 88% |