Back to models

Qwen2.5-Coder (1.5B)

ECI#240
103
Alibaba
Sep. 18, 2024
Open weights

Qwen2.5-Coder (1.5B) is an open-weights model from Alibaba, released September 18, 2024. It has an ECI score of 103 and ranks 240th of 260 tracked models. At the time of its release, it ranked 65th of 83 tracked models.

Qwen2.5-Coder (1.5B) vs select alternatives

DomainBenchmark
Qwen2.5-Coder (1.5B)
Alibaba
Sep. 18, 2024
Open weights
Qwen-7B
Alibaba
Sep. 28, 2023
Open weights
Llama 3.1-8B
Meta AI
Jul. 23, 2024
Open weights
GPT-4o mini
OpenAI
Jul. 18, 2024
Closed weights
ECI scoreBest score 167
103107117127
Ranking#240#233#215#181
Mathematics
GSM8KBest score 95%
66%
52%
82%
91%
Science
ARC AI2Best score 95%
45%
75%
n/a
n/a
World knowledge
MMLUBest score 88%
54%
45%
56%
82%

Model metadata

General
OrganizationAlibaba
Release dateSep. 18, 2024
Model accessibilityOpen weights
CountryChina
Knowledge cutoffUnknown
Provider notesQwen2.5-Coder Technical Report
Pricing
Input price—
Output price—
Training
Parameters1.5e9
Training compute5.1e22 FLOP
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown