Back to models

Qwen-7B

ECI#226
107
Alibaba
Sep. 28, 2023
Open weights

Qwen-7B is an open-weights model from Alibaba, released September 28, 2023. It has an ECI score of 107 and ranks 226th of 253 tracked models. At the time of its release, it ranked 13th of 29 tracked models.

Qwen-7B vs select alternatives

DomainBenchmark
Qwen-7B
Alibaba
Sep. 28, 2023
Open weights
Alibaba
Sep. 24, 2023
Open weights
01.AI
Nov. 22, 2023
Open weights
Baichuan
Sep. 6, 2023
Open weights
ECI scoreBest score 167
107113105103
Ranking#226#215#230#232
Conceptual reasoning
BBHBest score 89%
45%
55%
47%
49%
Language understanding
LAMBADABest score 87%
68%
71%
n/a
74%
PIQABest score 89%
78%
80%
n/a
78%
BoolQBest score 91%
76%
86%
n/a
67%
Mathematics
GSM8KBest score 95%
52%
61%
45%
53%
Science
ARC AI2Best score 95%
75%
84%
50%
38%
World knowledge
MMLUBest score 88%
45%
66%
64%
59%

Model metadata