Mixtral 8x7B
ECI#197
118Mixtral 8x7B is an open-weights model from Mistral AI, released December 11, 2023. It has an ECI score of 118 and ranks 197th of 249 tracked models. At the time of its release, it ranked 7th of 38 tracked models. At $0.54/Mtok for input tokens and $0.54/Mtok for output tokens, it is less expensive per token than similarly-capable models.
Input price$0.54 / 1M tokens
Output price$0.54 / 1M tokens
Parameters4.7e10
Training compute7.7e23 FLOP
Mixtral 8x7B vs select alternatives
Reasoning
| Domain | Benchmark | Mixtral 8x7B | |||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 118 | 112 | 118 | 119 | |
| Ranking | #197 | #212 | #195 | #193 | |
| Conceptual reasoning | DTBenchBest score 98.4% | ||||
| Language understanding | Adversarial NLIBest score 58.1% | ||||
HellaSwagBest score 95.3% | |||||
| Long context | ForecastBenchBest score 62.5 | 56.3 | — | — | 54.2 |
| Mathematics | GSM8KBest score 94.5% | ||||
MATH Level 5Best score 98.1% | |||||
| Science | ARC AI2Best score 95.3% | ||||
GPQA DiamondBest score 95.8% | |||||
| World knowledge | MMLUBest score 88.1% |
