Back to models

Falcon-180B

ECI#217
112
Technology Innovation Institute
Sep. 6, 2023
Open weights

Falcon-180B is an open-weights model from Technology Innovation Institute, released September 6, 2023. It has an ECI score of 112 and ranks 217th of 253 tracked models. At the time of its release, it ranked 8th of 24 tracked models.

Falcon-180B vs select alternatives

DomainBenchmark
Falcon-180B
Technology Innovation Institute
Sep. 6, 2023
Open weights
Falcon-40B
Technology Innovation Institute
May 25, 2023
Open weights
Mistral 7B v0.1
Mistral AI
Sep. 27, 2023
Open weights
Qwen-14B
Alibaba
Sep. 24, 2023
Open weights
ECI scoreBest score 167
112104112113
Ranking#217#231#216#215
Language understanding
LAMBADABest score 87%
80%
77%
n/a
71%
PIQABest score 89%
85%
83%
83%
80%
WinoGrandeBest score 89%
87%
77%
75%
n/a
BoolQBest score 91%
89%
83%
87%
86%
HellaSwagBest score 95%
89%
85%
81%
n/a
Mathematics
GSM8KBest score 95%
54%
34%
54%
61%
Science
OpenBookQABest score 88%
64%
57%
80%
n/a
ARC AI2Best score 95%
68%
62%
79%
84%
World knowledge
MMLUBest score 88%
71%
57%
63%
66%

Model metadata

General
OrganizationTechnology Innovation Institute
Release dateSep. 6, 2023
Model accessibilityOpen weights
CountryUnited Arab Emirates
Knowledge cutoffUnknown
Provider notesThe Falcon Series of Open Language Models
Pricing
Input price—
Output price—
Training
Parameters1.8e11
Training compute3.8e24 FLOP
Training hardwareNVIDIA A100 SXM4 40 GB
Training time180 days
Training dataset size3.5e12 datapoints