LLaMA-7B
ECI#235
96LLaMA-7B is an open-weights model from Meta AI, released February 24, 2023. It has an ECI score of 96 and ranks 235th of 249 tracked models. At the time of its release, it ranked 4th of 4 tracked models.
Input price—
Output price—
Parameters6.7e9
Training compute4.0e22 FLOP
LLaMA-7B vs select alternatives
Reasoning
| Domain | Benchmark | LLaMA-7B |
|---|---|---|
ECI scoreBest score 166 | 96 | |
| Ranking | #235 | |
| Conceptual reasoning | BBHBest score 89.2% | |
| Language understanding | LAMBADABest score 87.2% | |
PIQABest score 88.7% | ||
BoolQBest score 91.2% | ||
HellaSwagBest score 95.3% | ||
| Mathematics | GSM8KBest score 94.5% | |
| Science | OpenBookQABest score 88.0% | |
ARC AI2Best score 95.3% | ||
| World knowledge | MMLUBest score 88.1% |