GPT-4o (Nov 2024)
ECI#157
129GPT-4o (Nov 2024) is a closed-weights model from OpenAI, released November 20, 2024. It has an ECI score of 129 and ranks 157th of 249 tracked models. At the time of its release, it ranked 9th of 94 tracked models.
GPT-4o (Nov 2024) vs select alternatives
| Domain | Benchmark | GPT-4o (Nov 2024) | |||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 129 | 129 | 129 | 132 | |
| Ranking | #157 | #158 | #156 | #146 | |
| Conceptual reasoning | ARC-AGI-2Best score 95% | ||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | Humanity's Last ExamBest score 47% | ||||
GPQA DiamondBest score 96% | |||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 9 min 10 sec | 6 min 59 sec | — | — |
Aider PolyglotBest score 88% | |||||
WeirdML (v2)Best score 93% | |||||
| Other | LiveBenchBest score 82% |
