Phi-2 | Epoch AI

ECI#223

108

Microsoft

Dec. 12, 2023

Open weights

Phi-2 is an open-weights model from Microsoft, released December 12, 2023. It has an ECI score of 108 and ranks 223rd of 253 tracked models. At the time of its release, it ranked 17th of 39 tracked models.

Phi-2 vs select alternatives

Domain	Benchmark	Phi-2 Microsoft Dec. 12, 2023 Open weights	Phi-1.5 Microsoft Sep. 11, 2023 Open weights	Yi 6B 01.AI Nov. 22, 2023 Open weights	Mixtral 8x7B Mistral AI Dec. 11, 2023 Open weights
	ECI scoreBest score 167	108	92	105	118
	Ranking	#223	#247	#230	#201
Conceptual reasoning	BBHBest score 89%	59%	n/a	47%	n/a
Language understanding	Adversarial NLIBest score 58%	43%	n/a	n/a	55%
	WinoGrandeBest score 89%	55%	73%	71%	77%
	HellaSwagBest score 95%	54%	48%	74%	87%
Science	OpenBookQABest score 88%	74%	37%	n/a	86%
	ARC AI2Best score 95%	76%	44%	50%	87%
World knowledge	TriviaQABest score 88%	45%	n/a	n/a	82%
	MMLUBest score 88%	58%	38%	64%	71%

Model metadata

General
Organization	Microsoft
Release date	Dec. 12, 2023
Model accessibility	Open weights
Country	United States of America
Knowledge cutoff	Unknown
Provider notes	Phi-2: The surprising power of small language models

Pricing
Input price	—
Output price	—

Training
Parameters	2.7e9
Training compute	2.3e22 FLOP
Training hardware	NVIDIA A100
Training time	14 days
Training dataset size	2.5e11 datapoints