Phi-2
ECI#224
108Phi-2 is an open-weights model from Microsoft, released December 12, 2023. It has an ECI score of 108 and ranks 224th of 253 tracked models. At the time of its release, it ranked 16th of 38 tracked models.
Phi-2 vs select alternatives
| Domain | Benchmark | Phi-2 | |||
|---|---|---|---|---|---|
ECI scoreBest score 169 | 108 | 91 | 105 | 118 | |
| Ranking | #224 | #247 | #231 | #204 | |
| Conceptual reasoning | BBHBest score 89% | ||||
| Language understanding | Adversarial NLIBest score 58% | ||||
WinoGrandeBest score 89% | |||||
HellaSwagBest score 95% | |||||
| Science | OpenBookQABest score 88% | ||||
ARC AI2Best score 95% | |||||
| World knowledge | TriviaQABest score 88% | ||||
MMLUBest score 88% |
