Back to models

Qwen-14B

ECI#211
113
Alibaba
Sep. 24, 2023
Open weights

Qwen-14B is an open-weights model from Alibaba, released September 24, 2023. It has an ECI score of 113 and ranks 211th of 249 tracked models. At the time of its release, it ranked 8th of 27 tracked models.

Input price
Output price
Parameters1.4e10
Training compute2.5e23 FLOP

Qwen-14B vs select alternatives

DomainBenchmark
Qwen-14B
Alibaba
Sep. 24, 2023
Open weights
Mistral AI
Sep. 27, 2023
Open weights
Technology Innovation Institute
Sep. 6, 2023
Open weights
01.AI
Nov. 2, 2023
Open weights
ECI scoreBest score 166
113112112117
Ranking#211#212#213#200
Conceptual reasoning
BBHBest score 89.2%
55.0%
56.1%
n/a
71.7%
Language understanding
LAMBADABest score 87.2%
71.1%
n/a
79.8%
n/a
PIQABest score 88.7%
79.9%
83.0%
84.9%
n/a
BoolQBest score 91.2%
86.2%
87.4%
89.0%
n/a
Mathematics
GSM8KBest score 94.5%
61.3%
54.4%
54.4%
76.0%
Science
ARC AI2Best score 95.3%
84.4%
78.6%
67.8%
n/a
World knowledge
MMLUBest score 88.1%
66.3%
62.5%
70.6%
76.3%

Model metadata