Llama 3.1-8B
ECI#215
117Llama 3.1-8B is an open-weights model from Meta AI, released July 23, 2024. It has an ECI score of 117 and ranks 215th of 260 tracked models. At the time of its release, it ranked 34th of 74 tracked models.
Llama 3.1-8B vs select alternatives
| Domain | Benchmark | Llama 3.1-8B | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 117 | 116 | 123 | 119 | |
| Ranking | #215 | #216 | #191 | #207 | |
| Conceptual reasoning | LMCABest score 68.2 | 5.4 | — | — | 6.4 |
DTBenchBest score 99% | |||||
| Games | BALROGBest score 68% | ||||
Chess PuzzlesBest score 74% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 96% | ||||
| World knowledge | MMLUBest score 88% |
