GPT-4o mini
ECI#177
126GPT-4o mini is a closed-weights model from OpenAI, released July 18, 2024. It has an ECI score of 126 and ranks 177th of 253 tracked models. At the time of its release, it ranked 6th of 70 tracked models.
GPT-4o mini vs select alternatives
| Domain | Benchmark | GPT-4o mini | ||
|---|---|---|---|---|
ECI scoreBest score 169 | 126 | 126 | 127 | |
| Ranking | #177 | #178 | #173 | |
| Conceptual reasoning | LMCABest score 68.3 | 10.4 | 9.8 | — |
SimpleBenchBest score 82% | ||||
DTBenchBest score 99% | ||||
| Mathematics | FrontierMath Tiers 1-3 (v2)Best score 94% | |||
MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | ||||
| Science | GPQA DiamondBest score 96% | |||
| Software engineering | WeirdML (v2)Best score 94% | |||
| World knowledge | MMLUBest score 88% |