Back to models

Qwen-7B

ECI#223
89
Alibaba
Sep. 28, 2023
Open weights

Qwen-7B is an open-weights model from Alibaba, released September 28, 2023. It has an ECI score of 89 and ranks 223rd of 240 tracked models. At the time of its release, it ranked 17th of 28 tracked models.

Qwen-7B vs select alternatives

DomainBenchmark
Qwen-7B
Alibaba
Sep. 28, 2023
Open weights
Alibaba
Sep. 24, 2023
Open weights
Baichuan
Sep. 6, 2023
Open weights
01.AI
Nov. 22, 2023
Open weights
ECI scoreBest score 173
891029294
Ranking#223#210#220#218
Conceptual reasoning
BBHBest score 89%
45%
55%
49%
47%
Language understanding
LAMBADABest score 87%
68%
71%
74%
n/a
PIQABest score 89%
78%
80%
78%
n/a
BoolQBest score 91%
76%
86%
67%
n/a
Mathematics
GSM8KBest score 95%
52%
61%
53%
45%
Science
ARC AI2Best score 95%
75%
84%
38%
50%
World knowledge
MMLUBest score 88%
45%
66%
59%
64%

Model metadata