LLaMA-65B
ECI#216
110LLaMA-65B is an open-weights model from Meta AI, released February 24, 2023. It has an ECI score of 110 and ranks 216th of 249 tracked models. At the time of its release, it ranked 1st of 4 tracked models.
Input price—
Output price—
Parameters6.5e10
Training compute5.5e23 FLOP
LLaMA-65B vs select alternatives
Reasoning
| Domain | Benchmark | LLaMA-65B |
|---|---|---|
ECI scoreBest score 166 | 110 | |
| Ranking | #216 | |
| Conceptual reasoning | BBHBest score 89.2% | |
| Language understanding | LAMBADABest score 87.2% | |
PIQABest score 88.7% | ||
BoolQBest score 91.2% | ||
HellaSwagBest score 95.3% | ||
| Mathematics | GSM8KBest score 94.5% | |
| Science | OpenBookQABest score 88.0% | |
ARC AI2Best score 95.3% | ||
| World knowledge | MMLUBest score 88.1% |