Back to models

MPT-7B

ECI#239
94
MosaicML
May 5, 2023
Open weights

MPT-7B is an open-weights model from MosaicML, released May 5, 2023. It has an ECI score of 94 and ranks 239th of 249 tracked models. At the time of its release, it ranked 7th of 9 tracked models.

Input price—
Output price—
Parameters7.0e9
Training compute4.2e22 FLOP

MPT-7B vs select alternatives

Reasoning
DomainBenchmark
MPT-7B
MosaicML
May 5, 2023
Open weights
Falcon-7B
Technology Innovation Institute
Apr. 24, 2023
Open weights
XGen-7B
Salesforce
Jun. 27, 2023
Open weights
Baichuan1-7B
Baichuan
Jun. 1, 2023
Open weights
ECI scoreBest score 166
94959390
Ranking#239#238#242#244
Conceptual reasoning
BBHBest score 89.2%
35.6%
28.8%
n/a
32.5%
Language understanding
LAMBADABest score 87.2%
70.0%
74.9%
n/a
n/a
PIQABest score 88.7%
80.6%
80.3%
75.5%
76.2%
BoolQBest score 91.2%
75.0%
75.3%
74.3%
n/a
HellaSwagBest score 95.3%
76.4%
78.1%
74.2%
n/a
Mathematics
GSM8KBest score 94.5%
9.1%
6.8%
n/a
9.2%
Science
OpenBookQABest score 88.0%
51.4%
51.6%
40.2%
n/a
ARC AI2Best score 95.3%
42.6%
47.9%
41.2%
n/a
World knowledge
MMLUBest score 88.1%
30.8%
35.0%
36.3%
42.3%

Model metadata

General
OrganizationMosaicML
Release dateMay 5, 2023
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notes"Introducing MPT-7B: A New Standard for Open-Source, Commercially Usable LLMs"
Pricing
Input price—
Output price—
Training
Parameters7.0e9
Training compute4.2e22 FLOP
Training hardwareNVIDIA A100 SXM4 40 GB
Training time9.5 days
Training dataset sizeUnknown