Back to models

phi-3-small 7.4B

ECI#185
122
Microsoft
Apr. 23, 2024
Open weights

phi-3-small 7.4B is an open-weights model from Microsoft, released April 23, 2024. It has an ECI score of 122 and ranks 185th of 249 tracked models. At the time of its release, it ranked 9th of 59 tracked models.

Input price
Output price
Parameters7.4e9
Training compute2.1e23 FLOP

phi-3-small 7.4B vs select alternatives

DomainBenchmark
phi-3-small 7.4B
Microsoft
Apr. 23, 2024
Open weights
Microsoft
Dec. 12, 2023
Open weights
DeepSeek
May 7, 2024
Open weights
Meta AI
Apr. 18, 2024
Open weights
ECI scoreBest score 166
122108125116
Ranking#185#219#176#205
Conceptual reasoning
BBHBest score 89.2%
79.1%
59.4%
78.8%
n/a
Language understanding
Adversarial NLIBest score 58.1%
58.1%
42.5%
n/a
57.3%
WinoGrandeBest score 89.2%
81.5%
54.7%
86.3%
75.7%
HellaSwagBest score 95.3%
77.0%
53.6%
87.1%
n/a
Science
OpenBookQABest score 88.0%
88.0%
73.6%
n/a
82.6%
ARC AI2Best score 95.3%
90.7%
75.9%
92.2%
82.8%
World knowledge
TriviaQABest score 87.5%
58.1%
45.2%
80.0%
67.7%
MMLUBest score 88.1%
75.7%
58.4%
78.4%
68.8%

Model metadata