phi-3-small 7.4B is an open-weights model from Microsoft, released April 23, 2024. It has an ECI score of 122 and ranks 185th of 249 tracked models. At the time of its release, it ranked 9th of 59 tracked models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 122 | 108 | 125 | 116 | |
| Ranking | #185 | #219 | #176 | #205 | |
| Conceptual reasoning | BBHBest score 89.2% | ||||
| Language understanding | Adversarial NLIBest score 58.1% | ||||
WinoGrandeBest score 89.2% | |||||
HellaSwagBest score 95.3% | |||||
| Science | OpenBookQABest score 88.0% | ||||
ARC AI2Best score 95.3% | |||||
| World knowledge | TriviaQABest score 87.5% | ||||
MMLUBest score 88.1% |