Back to models

Phi-1.5

ECI#243
91
Microsoft
Sep. 11, 2023
Open weights

Phi-1.5 is an open-weights model from Microsoft, released September 11, 2023. It has an ECI score of 91 and ranks 243rd of 249 tracked models. At the time of its release, it ranked 22nd of 25 tracked models.

Input price—
Output price—
Parameters1.3e9
Training compute1.2e21 FLOP

Phi-1.5 vs select alternatives

Reasoning
DomainBenchmark
Phi-1.5
Microsoft
Sep. 11, 2023
Open weights
DeepSeek Coder 6.7B
DeepSeek
Nov. 2, 2023
Open weights
Baichuan 2-7B
Baichuan
Sep. 20, 2023
Open weights
Llama 2-7B
Meta AI
Jul. 18, 2023
Open weights
ECI scoreBest score 166
91899699
Ranking#243#246#236#234
Language understanding
WinoGrandeBest score 89.2%
73.4%
57.6%
n/a
69.2%
BoolQBest score 91.2%
75.8%
n/a
63.2%
77.9%
HellaSwagBest score 95.3%
47.6%
n/a
68.0%
77.2%
Science
OpenBookQABest score 88.0%
37.2%
n/a
n/a
58.6%
ARC AI2Best score 95.3%
44.4%
36.4%
32.5%
45.9%
World knowledge
MMLUBest score 88.1%
37.6%
36.4%
54.2%
45.8%

Model metadata

General
OrganizationMicrosoft
Release dateSep. 11, 2023
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesTextbooks Are All You Need II: phi-1.5 technical report
Pricing
Input price—
Output price—
Training
Parameters1.3e9
Training compute1.2e21 FLOP
Training hardwareNVIDIA A100 SXM4 40 GB
Training time8 days
Training dataset size3.0e10 datapoints