Llama 3.1-70B
ECI#172
126Llama 3.1-70B is an open-weights model from Meta AI, released July 23, 2024. It has an ECI score of 126 and ranks 172nd of 249 tracked models. At the time of its release, it ranked 9th of 74 tracked models.
Llama 3.1-70B vs select alternatives
| Domain | Benchmark | Llama 3.1-70B | |||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 126 | 123 | 125 | 127 | |
| Ranking | #172 | #180 | #175 | #170 | |
| Agent | The Agent CompanyBest score 52% | ||||
| Conceptual reasoning | LMCABest score 63.3 | 14.8 | — | — | 10.4 |
DTBenchBest score 98% | |||||
| Games | BALROGBest score 58% | ||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 96% | ||||
| Software engineering | WeirdML (v2)Best score 93% | ||||
| World knowledge | MMLUBest score 88% |
