LLaMA-33B
ECI#221
107LLaMA-33B is an open-weights model from Meta AI, released February 24, 2023. It has an ECI score of 107 and ranks 221st of 249 tracked models. At the time of its release, it ranked 2nd of 4 tracked models.
Input price—
Output price—
Parameters3.3e10
Training compute2.7e23 FLOP
LLaMA-33B vs select alternatives
Reasoning
| Domain | Benchmark | LLaMA-33B |
|---|---|---|
ECI scoreBest score 166 | 107 | |
| Ranking | #221 | |
| Conceptual reasoning | BBHBest score 89.2% | |
| Language understanding | LAMBADABest score 87.2% | |
PIQABest score 88.7% | ||
BoolQBest score 91.2% | ||
HellaSwagBest score 95.3% | ||
| Mathematics | GSM8KBest score 94.5% | |
| Science | OpenBookQABest score 88.0% | |
ARC AI2Best score 95.3% | ||
| World knowledge | MMLUBest score 88.1% |