Back to models

Falcon-40B

ECI#221
91
Technology Innovation Institute
May 25, 2023
Open weights

Falcon-40B is an open-weights model from Technology Innovation Institute, released May 25, 2023. It has an ECI score of 91 and ranks 221st of 240 tracked models. At the time of its release, it ranked 4th of 10 tracked models.

Falcon-40B vs select alternatives

DomainBenchmark
Falcon-40B
Technology Innovation Institute
May 25, 2023
Open weights
Falcon-7B
Technology Innovation Institute
Apr. 24, 2023
Open weights
GPT-4 (Mar 2023)
OpenAI
Mar. 14, 2023
Closed weights
LLaMA-65B
Meta AI
Feb. 24, 2023
Open weights
ECI scoreBest score 173
9173122102
Ranking#221#233#180#211
Conceptual reasoning
BBHBest score 89%
37%
29%
n/a
58%
Language understanding
LAMBADABest score 87%
77%
75%
n/a
78%
PIQABest score 89%
83%
80%
n/a
83%
BoolQBest score 91%
83%
75%
n/a
87%
HellaSwagBest score 95%
85%
78%
95%
84%
Mathematics
GSM8KBest score 95%
34%
7%
92%
54%
Science
OpenBookQABest score 88%
57%
52%
n/a
60%
ARC AI2Best score 95%
62%
48%
n/a
70%
World knowledge
MMLUBest score 88%
57%
35%
86%
63%

Model metadata

General
OrganizationTechnology Innovation Institute
Release dateMay 25, 2023
Model accessibilityOpen weights
CountryUnited Arab Emirates
Knowledge cutoffUnknown
Provider notesAbu Dhabi-based Technology Innovation Institute Introduces Falcon LLM: Foundational Large Language Model (LLM) outperforms GPT-3 with 40 Billion Parameters
Pricing
Input price—
Output price—
Training
Parameters4.0e10
Training compute2.4e23 FLOP
Training hardwareNVIDIA A100
Training time60 days
Training dataset size1.0e12 datapoints