Mistral NeMo
ECI#194
119Mistral NeMo is an open-weights model from Mistral AI, released July 18, 2024. It has an ECI score of 119 and ranks 194th of 249 tracked models. At the time of its release, it ranked 24th of 71 tracked models.
Mistral NeMo vs select alternatives
| Domain | Benchmark | Mistral NeMo | |||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 119 | 118 | 122 | 120 | |
| Ranking | #194 | #197 | #183 | #190 | |
| Conceptual reasoning | DTBenchBest score 98% | ||||
| Language understanding | PIQABest score 89% | ||||
BoolQBest score 91% | |||||
| Mathematics | GSM8KBest score 95% | ||||
MATH Level 5Best score 98% | |||||
| Science | GPQA DiamondBest score 96% |
