GPT-4o (Nov 2024)
ECI#170
129GPT-4o (Nov 2024) is a closed-weights model from OpenAI, released November 20, 2024. It has an ECI score of 129 and ranks 170th of 260 tracked models. At the time of its release, it ranked 11th of 94 tracked models.
GPT-4o (Nov 2024) vs select alternatives
| Domain | Benchmark | GPT-4o (Nov 2024) | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 129 | 127 | 129 | 127 | |
| Ranking | #170 | #176 | #168 | #177 | |
| Long context | ForecastBenchBest score 67.0 | 60.6 | 63.2 | — | — |
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Multimodal | Video-MMEBest score 80% | ||||
| Science | CritPtBest score 32% | ||||
GPQA DiamondBest score 96% | |||||
| Software engineering | Aider PolyglotBest score 88% | ||||
WeirdML (v2)Best score 94% | |||||
| Other | LiveBenchBest score 82% |
