Back to models

StarCoder 2 3B

ECI#247
88
Hugging Face
Feb. 22, 2024
Open weights

StarCoder 2 3B is an open-weights model from Hugging Face, ServiceNow, NVIDIA, and BigCode, released February 22, 2024. It has an ECI score of 88 and ranks 247th of 249 tracked models. At the time of its release, it ranked 45th of 47 tracked models.

StarCoder 2 3B vs select alternatives

DomainBenchmark
StarCoder 2 3B
Hugging Face
Feb. 22, 2024
Open weights
Hugging Face
Feb. 20, 2024
Open weights
Google DeepMind
Feb. 21, 2024
Open weights
Meta AI
Apr. 18, 2024
Open weights
ECI scoreBest score 166
889394116
Ranking#247#241#240#205
Language understanding
WinoGrandeBest score 89%
57%
57%
65%
76%
Mathematics
GSM8KBest score 95%
22%
33%
18%
n/a
Science
ARC AI2Best score 95%
34%
39%
42%
83%
World knowledge
MMLUBest score 88%
37%
39%
42%
69%

Model metadata