Mixtral 8x7B
ECI#201
118Mixtral 8x7B is an open-weights model from Mistral AI, released December 11, 2023. It has an ECI score of 118 and ranks 201st of 253 tracked models. At the time of its release, it ranked 7th of 38 tracked models.
Mixtral 8x7B vs select alternatives
| Domain | Benchmark | Mixtral 8x7B | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 118 | 112 | 119 | 119 | |
| Ranking | #201 | #216 | #199 | #197 | |
| Conceptual reasoning | DTBenchBest score 99% | ||||
| Language understanding | Adversarial NLIBest score 58% | ||||
HellaSwagBest score 95% | |||||
| Long context | ForecastBenchBest score 62.5 | 56.3 | — | — | 54.2 |
| Mathematics | GSM8KBest score 95% | ||||
MATH Level 5Best score 98% | |||||
| Science | ARC AI2Best score 95% | ||||
GPQA DiamondBest score 96% | |||||
| World knowledge | MMLUBest score 88% |
