LLaMA-65B
ECI#220
110LLaMA-65B is an open-weights model from Meta AI, released February 24, 2023. It has an ECI score of 110 and ranks 220th of 253 tracked models. At the time of its release, it ranked 1st of 4 tracked models.
LLaMA-65B vs select alternatives
| Domain | Benchmark | LLaMA-65B |
|---|---|---|
ECI scoreBest score 167 | 110 | |
| Ranking | #220 | |
| Conceptual reasoning | BBHBest score 89% | |
| Language understanding | LAMBADABest score 87% | |
PIQABest score 89% | ||
BoolQBest score 91% | ||
HellaSwagBest score 95% | ||
| Mathematics | GSM8KBest score 95% | |
| Science | OpenBookQABest score 88% | |
ARC AI2Best score 95% | ||
| World knowledge | MMLUBest score 88% |