DeepSeek Coder 6.7B is an open-weights model from DeepSeek and Peking University, released November 2, 2023. It has an ECI score of 89 and ranks 246th of 249 tracked models. At the time of its release, it ranked 31st of 33 tracked models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 89 | 91 | 96 | 104 | |
| Ranking | #246 | #243 | #236 | #226 | |
| Language understanding | WinoGrandeBest score 89.2% | ||||
| Mathematics | GSM8KBest score 94.5% | ||||
| Science | ARC AI2Best score 95.3% | ||||
| World knowledge | MMLUBest score 88.1% |