Back to models

Mixtral 8x7B

ECI#204
118
Mistral AI
Dec. 11, 2023
Open weights

Mixtral 8x7B is an open-weights model from Mistral AI, released December 11, 2023. It has an ECI score of 118 and ranks 204th of 253 tracked models. At the time of its release, it ranked 7th of 37 tracked models.

Mixtral 8x7B vs select alternatives

DomainBenchmark
Mixtral 8x7B
Mistral AI
Dec. 11, 2023
Open weights
Mistral 7B v0.1
Mistral AI
Sep. 27, 2023
Open weights
GPT-3.5 Turbo (Nov 2023)
OpenAI
Nov. 6, 2023
Closed weights
Claude 2.1
Anthropic
Nov. 21, 2023
Closed weights
ECI scoreBest score 169
118112119119
Ranking#204#218#203#198
Conceptual reasoning
DTBenchBest score 99%
50%
n/a
n/a
51%
Language understanding
Adversarial NLIBest score 58%
55%
47%
58%
n/a
HellaSwagBest score 95%
87%
81%
n/a
n/a
Long context
ForecastBenchBest score 67.0
58.2——58.7
Mathematics
GSM8KBest score 95%
74%
54%
n/a
n/a
MATH Level 5Best score 98%
10%
n/a
16%
n/a
Science
ARC AI2Best score 95%
87%
79%
87%
n/a
GPQA DiamondBest score 96%
31%
n/a
28%
33%
World knowledge
MMLUBest score 88%
71%
63%
71%
74%

Model metadata

General
OrganizationMistral AI
Release dateDec. 11, 2023
Model accessibilityOpen weights
CountryFrance
Knowledge cutoffUnknown
Provider notesMixtral of experts: A high quality Sparse Mixture-of-Experts.
Pricing
Input price$0.54 / 1M tokens
Output price$0.54 / 1M tokens
Training
Parameters4.7e10
Training compute7.7e23 FLOP
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown