Llama 3.1-8B
ECI#204
117Llama 3.1-8B is an open-weights model from Meta AI, released July 23, 2024. It has an ECI score of 117 and ranks 204th of 249 tracked models. At the time of its release, it ranked 34th of 74 tracked models.
Llama 3.1-8B vs select alternatives
| Domain | Benchmark | Llama 3.1-8B | |||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 117 | 116 | 123 | 118 | |
| Ranking | #204 | #205 | #180 | #196 | |
| Conceptual reasoning | LMCABest score 63.3 | 5.4 | — | — | 6.4 |
DTBenchBest score 98% | |||||
| Games | BALROGBest score 58% | ||||
Chess PuzzlesBest score 72% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 96% | ||||
| World knowledge | MMLUBest score 88% |
