Back to models

Falcon-180B

ECI#205
107
Technology Innovation Institute
Sep. 6, 2023
Open weights

Falcon-180B is an open-weights model from Technology Innovation Institute, released September 6, 2023. It has an ECI score of 107 and ranks 205th of 240 tracked models. At the time of its release, it ranked 6th of 23 tracked models.

Falcon-180B vs select alternatives

DomainBenchmark
Falcon-180B
Technology Innovation Institute
Sep. 6, 2023
Open weights
Falcon-40B
Technology Innovation Institute
May 25, 2023
Open weights
Stable Beluga 2
Stability AI
Jul. 20, 2023
Open weights
Mistral 7B v0.1
Mistral AI
Sep. 27, 2023
Open weights
ECI scoreBest score 173
10791110103
Ranking#205#221#202#209
Language understanding
LAMBADABest score 87%
80%
77%
71%
n/a
PIQABest score 89%
85%
83%
83%
83%
WinoGrandeBest score 89%
87%
77%
n/a
75%
BoolQBest score 91%
89%
83%
89%
87%
HellaSwagBest score 95%
89%
85%
84%
81%
Mathematics
GSM8KBest score 95%
54%
34%
70%
54%
Science
OpenBookQABest score 88%
64%
57%
n/a
80%
ARC AI2Best score 95%
68%
62%
86%
79%
World knowledge
MMLUBest score 88%
71%
57%
69%
63%

Model metadata

General
OrganizationTechnology Innovation Institute
Release dateSep. 6, 2023
Model accessibilityOpen weights
CountryUnited Arab Emirates
Knowledge cutoffUnknown
Provider notesThe Falcon Series of Open Language Models
Pricing
Input price—
Output price—
Training
Parameters1.8e11
Training compute3.8e24 FLOP
Training hardwareNVIDIA A100 SXM4 40 GB
Training time180 days
Training dataset size3.5e12 datapoints