Back to models

Mixtral 8x22B

ECI#187
122
Mistral AI
Apr. 17, 2024
Open weights

Mixtral 8x22B is an open-weights model from Mistral AI, released April 17, 2024. It has an ECI score of 122 and ranks 187th of 253 tracked models. At the time of its release, it ranked 6th of 54 tracked models.

Mixtral 8x22B vs select alternatives

DomainBenchmark
Mixtral 8x22B
Mistral AI
Apr. 17, 2024
Open weights
Mistral AI
Feb. 26, 2024
Closed weights
Google DeepMind
May 23, 2024
Closed weights
Microsoft
Apr. 23, 2024
Open weights
ECI scoreBest score 167
122122123121
Ranking#187#188#185#190
Conceptual reasoning
DTBenchBest score 99%
55%
56%
51%
n/a
Long context
ForecastBenchBest score 62.5
56.3—53.9—
Mathematics
MATH Level 5Best score 98%
24%
24%
25%
18%
Science
GPQA DiamondBest score 96%
34%
39%
40%
28%
World knowledge
MMLUBest score 88%
78%
69%
78%
78%

Model metadata