Back to models

Mistral Large 2 (Jul 2024)

ECI#168
126
Mistral AI
Jul. 24, 2024
Open weights

Mistral Large 2 (Jul 2024) is an open-weights model from Mistral AI, released July 24, 2024. It has an ECI score of 126 and ranks 168th of 239 tracked models. At the time of its release, it ranked 4th of 68 tracked models.

Mistral Large 2 (Jul 2024) vs select alternatives

DomainBenchmark
Mistral Large 2 (Jul 2024)
Mistral AI
Jul. 24, 2024
Open weights
Mistral AI
Feb. 26, 2024
Closed weights
Anthropic
Jun. 20, 2024
Closed weights
OpenAI
May 13, 2024
Closed weights
ECI scoreBest score 174
126120130128
Ranking#168#184#156#160
Conceptual reasoning
SimpleBenchBest score 82%
23%
n/a
28%
n/a
DTBenchBest score 99%
61%
56%
68%
65%
Long context
ForecastBenchBest score 66.7
61.5—62.961.0
Mathematics
MATH Level 5Best score 98%
45%
24%
52%
51%
OTIS Mock AIME 2024-2025Best score 100%
8%
2%
7%
6%
Science
GPQA DiamondBest score 96%
49%
39%
54%
49%
World knowledge
MMLUBest score 88%
80%
69%
87%
84%

Model metadata