Back to models

Falcon-7B

ECI#238
95
Technology Innovation Institute
Apr. 24, 2023
Open weights

Falcon-7B is an open-weights model from Technology Innovation Institute, released April 24, 2023. It has an ECI score of 95 and ranks 238th of 249 tracked models. At the time of its release, it ranked 6th of 8 tracked models.

Input price—
Output price—
Parameters7.0e9
Training compute6.3e22 FLOP

Falcon-7B vs select alternatives

Reasoning
DomainBenchmark
Falcon-7B
Technology Innovation Institute
Apr. 24, 2023
Open weights
MPT-7B
MosaicML
May 5, 2023
Open weights
LLaMA-7B
Meta AI
Feb. 24, 2023
Open weights
Baichuan1-7B
Baichuan
Jun. 1, 2023
Open weights
ECI scoreBest score 166
95949690
Ranking#238#239#235#244
Conceptual reasoning
BBHBest score 89.2%
28.8%
35.6%
33.5%
32.5%
Language understanding
LAMBADABest score 87.2%
74.9%
70.0%
73.3%
n/a
PIQABest score 88.7%
80.3%
80.6%
79.8%
76.2%
BoolQBest score 91.2%
75.3%
75.0%
76.5%
n/a
HellaSwagBest score 95.3%
78.1%
76.4%
76.2%
n/a
Mathematics
GSM8KBest score 94.5%
6.8%
9.1%
11.0%
9.2%
Science
OpenBookQABest score 88.0%
51.6%
51.4%
57.2%
n/a
ARC AI2Best score 95.3%
47.9%
42.6%
47.6%
n/a
World knowledge
MMLUBest score 88.1%
35.0%
30.8%
35.6%
42.3%

Model metadata

General
OrganizationTechnology Innovation Institute
Release dateApr. 24, 2023
Model accessibilityOpen weights
CountryUnited Arab Emirates
Knowledge cutoffUnknown
Provider notesFalcon-7B
Pricing
Input price—
Output price—
Training
Parameters7.0e9
Training compute6.3e22 FLOP
Training hardwareNVIDIA A100 SXM4 40 GB
Training timeUnknown
Training dataset size1.5e12 datapoints