Back to models

Mixtral 8x7B

ECI#196
113
Mistral AI
Dec. 11, 2023
Open weights

Mixtral 8x7B is an open-weights model from Mistral AI, released December 11, 2023. It has an ECI score of 113 and ranks 196th of 240 tracked models. At the time of its release, it ranked 5th of 33 tracked models.

Mixtral 8x7B vs select alternatives

DomainBenchmark
Mixtral 8x7B
Mistral AI
Dec. 11, 2023
Open weights
Mistral 7B v0.1
Mistral AI
Sep. 27, 2023
Open weights
GPT-4 (Mar 2023)
OpenAI
Mar. 14, 2023
Closed weights
Claude 2
Anthropic
Jul. 11, 2023
Closed weights
ECI scoreBest score 173
113103122117
Ranking#196#209#180#191
Conceptual reasoning
DTBenchBest score 99%
50%
n/a
n/a
52%
Language understanding
Adversarial NLIBest score 58%
55%
47%
n/a
n/a
HellaSwagBest score 95%
87%
81%
95%
n/a
Mathematics
GSM8KBest score 95%
74%
54%
92%
n/a
MATH Level 5Best score 98%
10%
n/a
n/a
12%
Science
OpenBookQABest score 88%
86%
80%
n/a
n/a
ARC AI2Best score 95%
87%
79%
n/a
n/a
GPQA DiamondBest score 97%
31%
n/a
36%
35%
World knowledge
MMLUBest score 88%
71%
63%
86%
79%

Model metadata

General
OrganizationMistral AI
Release dateDec. 11, 2023
Model accessibilityOpen weights
CountryFrance
Knowledge cutoffUnknown
Provider notesMixtral of experts: A high quality Sparse Mixture-of-Experts.
Pricing
Input price$0.54 / 1M tokens
Output price$0.54 / 1M tokens
Training
Parameters4.7e10
Training compute7.7e23 FLOP
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown