Back to models

StarCoder 2 3B

ECI#247
88
Hugging Face
Feb. 22, 2024
Open weights

StarCoder 2 3B is an open-weights model from Hugging Face, ServiceNow, NVIDIA, and BigCode, released February 22, 2024. It has an ECI score of 88 and ranks 247th of 249 tracked models. At the time of its release, it ranked 45th of 47 tracked models.

StarCoder 2 3B vs select alternatives

DomainBenchmark
StarCoder 2 3B
Hugging Face
Feb. 22, 2024
Open weights
StarCoder 2 7B
Hugging Face
Feb. 20, 2024
Open weights
Gemma 2B
Google DeepMind
Feb. 21, 2024
Open weights
Llama 3-8B
Meta AI
Apr. 18, 2024
Open weights
ECI scoreBest score 166
889394116
Ranking#247#241#240#205
Language understanding
WinoGrandeBest score 89%
57%
57%
65%
76%
Mathematics
GSM8KBest score 95%
22%
33%
18%
n/a
Science
ARC AI2Best score 95%
34%
39%
42%
83%
World knowledge
MMLUBest score 88%
37%
39%
42%
69%

Model metadata

General
OrganizationHugging Face, ServiceNow, NVIDIA, BigCode
Release dateFeb. 22, 2024
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesStarCoder 2 and The Stack v2: The Next Generation
Pricing
Input price—
Output price—
Training
Parameters3.0e9
Training compute5.9e22 FLOP
Training hardwareNVIDIA A100 SXM4 80 GB
Training timeUnknown
Training dataset size6.2e11 datapoints