Back to models

phi-3-small 7.4B

ECI#192
116
Microsoft
Apr. 23, 2024
Open weights

phi-3-small 7.4B is an open-weights model from Microsoft, released April 23, 2024. It has an ECI score of 116 and ranks 192nd of 240 tracked models. At the time of its release, it ranked 12th of 53 tracked models.

phi-3-small 7.4B vs select alternatives

DomainBenchmark
phi-3-small 7.4B
Microsoft
Apr. 23, 2024
Open weights
Microsoft
Dec. 12, 2023
Open weights
DeepSeek
May 7, 2024
Open weights
Meta AI
Apr. 18, 2024
Open weights
ECI scoreBest score 173
11696121109
Ranking#192#216#182#203
Conceptual reasoning
BBHBest score 89%
79%
59%
79%
n/a
Language understanding
Adversarial NLIBest score 58%
58%
43%
n/a
57%
WinoGrandeBest score 89%
82%
55%
86%
76%
HellaSwagBest score 95%
77%
54%
87%
n/a
Science
OpenBookQABest score 88%
88%
74%
n/a
83%
ARC AI2Best score 95%
91%
76%
92%
83%
World knowledge
TriviaQABest score 88%
58%
45%
80%
68%
MMLUBest score 88%
76%
58%
78%
69%

Model metadata