MPT-7B | Epoch AI

ECI#243

95

MosaicML

May 5, 2023

Open weights

MPT-7B is an open-weights model from MosaicML, released May 5, 2023. It has an ECI score of 95 and ranks 243rd of 253 tracked models. At the time of its release, it ranked 7th of 9 tracked models.

MPT-7B vs select alternatives

Domain	Benchmark	MPT-7B MosaicML May 5, 2023 Open weights	Falcon-7B Technology Innovation Institute Apr. 24, 2023 Open weights	XGen-7B Salesforce Jun. 27, 2023 Open weights	Baichuan1-7B Baichuan Jun. 1, 2023 Open weights
	ECI scoreBest score 167	95	95	93	91
	Ranking	#243	#242	#246	#248
Conceptual reasoning	BBHBest score 89%	36%	29%	n/a	32%
Language understanding	LAMBADABest score 87%	70%	75%	n/a	n/a
	PIQABest score 89%	81%	80%	76%	76%
	BoolQBest score 91%	75%	75%	74%	n/a
	HellaSwagBest score 95%	76%	78%	74%	n/a
Mathematics	GSM8KBest score 95%	9%	7%	n/a	9%
Science	OpenBookQABest score 88%	51%	52%	40%	n/a
	ARC AI2Best score 95%	43%	48%	41%	n/a
World knowledge	MMLUBest score 88%	31%	35%	36%	42%

Model metadata

General
Organization	MosaicML
Release date	May 5, 2023
Model accessibility	Open weights
Country	United States of America
Knowledge cutoff	Unknown
Provider notes	"Introducing MPT-7B: A New Standard for Open-Source, Commercially Usable LLMs"

Pricing
Input price	—
Output price	—

Training
Parameters	7.0e9
Training compute	4.2e22 FLOP
Training hardware	NVIDIA A100 SXM4 40 GB
Training time	9.5 days
Training dataset size	Unknown