Mistral Large is a closed-weights model from Mistral AI, released February 26, 2024. It has an ECI score of 122 and ranks 183rd of 249 tracked models. At the time of its release, it ranked 4th of 49 tracked models. At $2/Mtok for input tokens and $6/Mtok for output tokens, it is more expensive per token than similarly-capable models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 122 | 118 | 126 | 120 | |
| Ranking | #183 | #197 | #171 | #188 | |
| Conceptual reasoning | DTBenchBest score 98.4% | ||||
| Mathematics | MATH Level 5Best score 98.1% | ||||
| Science | GPQA DiamondBest score 95.8% | ||||
| World knowledge | MMLUBest score 88.1% |