GPT-4o mini
ECI#174
127GPT-4o mini is a closed-weights model from OpenAI, released July 18, 2024. It has an ECI score of 127 and ranks 174th of 253 tracked models. At the time of its release, it ranked 6th of 71 tracked models.
GPT-4o mini vs select alternatives
| Domain | Benchmark | GPT-4o mini | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 127 | 126 | 127 | 129 | |
| Ranking | #174 | #175 | #169 | #165 | |
| Conceptual reasoning | LMCABest score 68.2 | 10.4 | 9.8 | — | — |
SimpleBenchBest score 82% | |||||
DTBenchBest score 99% | |||||
| Games | Chess PuzzlesBest score 72% | ||||
| Mathematics | FrontierMath Tiers 1-3 (v2)Best score 94% | ||||
MATH Level 5Best score 98% | |||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 96% | ||||
| Software engineering | WeirdML (v2)Best score 94% |
