Back to models

StarCoder 2 7B

ECI#241
93
Hugging Face
Feb. 20, 2024
Open weights

StarCoder 2 7B is an open-weights model from Hugging Face, ServiceNow, NVIDIA, and BigCode, released February 20, 2024. It has an ECI score of 93 and ranks 241st of 249 tracked models. At the time of its release, it ranked 37th of 44 tracked models.

StarCoder 2 7B vs select alternatives

DomainBenchmark
StarCoder 2 7B
Hugging Face
Feb. 20, 2024
Open weights
Gemma 2B
Google DeepMind
Feb. 21, 2024
Open weights
Llama 3-8B
Meta AI
Apr. 18, 2024
Open weights
Claude 3 Haiku
Anthropic
Mar. 7, 2024
Closed weights
ECI scoreBest score 166
9394116118
Ranking#241#240#205#198
Language understanding
WinoGrandeBest score 89%
57%
65%
76%
74%
Mathematics
GSM8KBest score 95%
33%
18%
n/a
n/a
Science
ARC AI2Best score 95%
39%
42%
83%
n/a
World knowledge
MMLUBest score 88%
39%
42%
69%
74%

Model metadata

General
OrganizationHugging Face, ServiceNow, NVIDIA, BigCode
Release dateFeb. 20, 2024
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesStarCoder 2 and The Stack v2: The Next Generation
Pricing
Input price—
Output price—
Training
Parameters7.0e9
Training compute1.5e23 FLOP
Training hardwareNVIDIA H100 SXM5 80GB
Training timeUnknown
Training dataset size6.6e11 datapoints