GPT-4o (Aug 2024)
ECI#162
129GPT-4o (Aug 2024) is a closed-weights model from OpenAI, released August 6, 2024. It has an ECI score of 129 and ranks 162nd of 253 tracked models. At the time of its release, it ranked 3rd of 76 tracked models.
GPT-4o (Aug 2024) vs select alternatives
| Domain | Benchmark | GPT-4o (Aug 2024) | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 129 | 129 | 130 | 129 | |
| Ranking | #162 | #160 | #155 | #163 | |
| Conceptual reasoning | SimpleBenchBest score 82% | ||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Multimodal | Video-MMEBest score 80% | ||||
| Science | GPQA DiamondBest score 96% | ||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 6 min 59 sec | — | 11 min 24 sec | — |
| World knowledge | MMLUBest score 88% |
