Phi-1.5 | Epoch AI

ECI#247

92

Microsoft

Sep. 11, 2023

Open weights

Phi-1.5 is an open-weights model from Microsoft, released September 11, 2023. It has an ECI score of 92 and ranks 247th of 253 tracked models. At the time of its release, it ranked 22nd of 25 tracked models.

Phi-1.5 vs select alternatives

Domain	Benchmark	Phi-1.5 Microsoft Sep. 11, 2023 Open weights	DeepSeek Coder 6.7B DeepSeek Nov. 2, 2023 Open weights	Baichuan 2-7B Baichuan Sep. 20, 2023 Open weights	Llama 2-7B Meta AI Jul. 18, 2023 Open weights
	ECI scoreBest score 167	92	90	96	99
	Ranking	#247	#250	#240	#238
Language understanding	WinoGrandeBest score 89%	73%	58%	n/a	69%
	BoolQBest score 91%	76%	n/a	63%	78%
	HellaSwagBest score 95%	48%	n/a	68%	77%
Science	OpenBookQABest score 88%	37%	n/a	n/a	59%
	ARC AI2Best score 95%	44%	36%	33%	46%
World knowledge	MMLUBest score 88%	38%	36%	54%	46%

Model metadata

General
Organization	Microsoft
Release date	Sep. 11, 2023
Model accessibility	Open weights
Country	United States of America
Knowledge cutoff	Unknown
Provider notes	Textbooks Are All You Need II: phi-1.5 technical report

Pricing
Input price	—
Output price	—

Training
Parameters	1.3e9
Training compute	1.2e21 FLOP
Training hardware	NVIDIA A100 SXM4 40 GB
Training time	8 days
Training dataset size	3.0e10 datapoints