Back to models

DeepSeek Coder 33B

ECI#239
96
DeepSeek
Nov. 2, 2023
Open weights

DeepSeek Coder 33B is an open-weights model from DeepSeek and Peking University, released November 2, 2023. It has an ECI score of 96 and ranks 239th of 251 tracked models. At the time of its release, it ranked 24th of 33 tracked models.

DeepSeek Coder 33B vs select alternatives

DomainBenchmark
DeepSeek Coder 33B
DeepSeek
Nov. 2, 2023
Open weights
Baichuan
Sep. 20, 2023
Open weights
Microsoft
Sep. 11, 2023
Open weights
01.AI
Nov. 22, 2023
Open weights
ECI scoreBest score 167
969691104
Ranking#239#238#245#228
Language understanding
WinoGrandeBest score 89%
62%
n/a
73%
71%
Mathematics
GSM8KBest score 95%
35%
25%
n/a
45%
Science
ARC AI2Best score 95%
42%
33%
44%
50%
World knowledge
MMLUBest score 88%
39%
54%
38%
64%

Model metadata