MPT-30B | Epoch AI

ECI#224

85

MosaicML

Jun. 22, 2023

Open weights

MPT-30B is an open-weights model from MosaicML, released June 22, 2023. It has an ECI score of 85 and ranks 224th of 240 tracked models. At the time of its release, it ranked 7th of 13 tracked models.

MPT-30B vs select alternatives

Domain	Benchmark	MPT-30B MosaicML Jun. 22, 2023 Open weights	MPT-7B MosaicML May 5, 2023 Open weights	Llama 2-7B Meta AI Jul. 18, 2023 Open weights	Falcon-40B Technology Innovation Institute May 25, 2023 Open weights
	ECI scoreBest score 173	85	74	83	91
	Ranking	#224	#232	#228	#221
Conceptual reasoning	BBHBest score 89%	38%	36%	39%	37%
Language understanding	PIQABest score 89%	82%	81%	79%	83%
	WinoGrandeBest score 89%	71%	69%	69%	77%
	BoolQBest score 91%	85%	75%	78%	83%
Mathematics	GSM8KBest score 95%	34%	9%	17%	34%
Science	OpenBookQABest score 88%	52%	51%	59%	57%
	ARC AI2Best score 95%	51%	43%	46%	62%
World knowledge	TriviaQABest score 88%	74%	62%	74%	80%
	MMLUBest score 88%	48%	31%	46%	57%

Model metadata

General
Organization	MosaicML
Release date	Jun. 22, 2023
Model accessibility	Open weights
Country	United States of America
Knowledge cutoff	Unknown
Provider notes	huggingface.co

Pricing
Input price	—
Output price	—

Training
Parameters	3.0e10
Training compute	1.9e23 FLOP
Training hardware	NVIDIA H100 SXM5 80GB
Training time	11.6 days
Training dataset size	1.1e12 datapoints