Mistral NeMo
ECI#192
114Mistral NeMo is an open-weights model from Mistral AI, released July 18, 2024. It has an ECI score of 114 and ranks 192nd of 237 tracked models. At the time of its release, it ranked 23rd of 64 tracked models.
Mistral NeMo vs select alternatives
| Domain | Benchmark | Mistral NeMo | |||
|---|---|---|---|---|---|
ECI scoreBest score 169 | 114 | 113 | 119 | 113 | |
| Ranking | #192 | #193 | #185 | #196 | |
| Conceptual reasoning | DTBenchBest score 99% | ||||
| Language understanding | PIQABest score 89% | ||||
BoolQBest score 91% | |||||
| Mathematics | GSM8KBest score 95% | ||||
MATH Level 5Best score 98% | |||||
| Science | GPQA DiamondBest score 96% |
