Back to models

Mistral Large 2 (Jul 2024)

ECI#173
128
Mistral AI
Jul. 24, 2024
Open weights

Mistral Large 2 (Jul 2024) is an open-weights model from Mistral AI, released July 24, 2024. It has an ECI score of 128 and ranks 173rd of 260 tracked models. At the time of its release, it ranked 4th of 75 tracked models.

Mistral Large 2 (Jul 2024) vs select alternatives

DomainBenchmark
Mistral Large 2 (Jul 2024)
Mistral AI
Jul. 24, 2024
Open weights
Mistral AI
Apr. 17, 2024
Open weights
Anthropic
Jun. 20, 2024
Closed weights
OpenAI
May 13, 2024
Closed weights
ECI scoreBest score 167
128122130129
Ranking#173#194#162#166
Conceptual reasoning
SimpleBenchBest score 82%
23%
n/a
28%
n/a
DTBenchBest score 99%
61%
55%
68%
65%
Long context
ForecastBenchBest score 67.0
61.758.863.161.2
Mathematics
MATH Level 5Best score 98%
45%
24%
52%
51%
OTIS Mock AIME 2024-2025Best score 100%
8%
n/a
7%
6%
Science
GPQA DiamondBest score 96%
49%
34%
54%
49%
World knowledge
MMLUBest score 88%
80%
78%
87%
84%

Model metadata