Back to models

Qwen-7B

ECI#222
107
Alibaba
Sep. 28, 2023
Open weights

Qwen-7B is an open-weights model from Alibaba, released September 28, 2023. It has an ECI score of 107 and ranks 222nd of 249 tracked models. At the time of its release, it ranked 13th of 29 tracked models.

Input price
Output price
Parameters7.0e9
Training compute1.0e23 FLOP

Qwen-7B vs select alternatives

DomainBenchmark
Qwen-7B
Alibaba
Sep. 28, 2023
Open weights
Alibaba
Sep. 24, 2023
Open weights
01.AI
Nov. 22, 2023
Open weights
Baichuan
Sep. 6, 2023
Open weights
ECI scoreBest score 166
107113104103
Ranking#222#211#226#228
Conceptual reasoning
BBHBest score 89.2%
45.0%
55.0%
47.2%
49.0%
Language understanding
LAMBADABest score 87.2%
67.9%
71.1%
n/a
74.0%
PIQABest score 88.7%
77.9%
79.9%
n/a
78.1%
BoolQBest score 91.2%
76.4%
86.2%
n/a
67.0%
Mathematics
GSM8KBest score 94.5%
51.7%
61.3%
44.9%
52.8%
Science
ARC AI2Best score 95.3%
75.3%
84.4%
50.3%
38.0%
World knowledge
MMLUBest score 88.1%
45.0%
66.3%
64.0%
59.2%

Model metadata