Back to models

GPT-4o (May 2024)

ECI#160
129
OpenAI
May 13, 2024
Closed weights

GPT-4o (May 2024) is a closed-weights model from OpenAI, released May 13, 2024. It has an ECI score of 129 and ranks 160th of 253 tracked models. At the time of its release, it ranked 1st of 62 tracked models.

GPT-4o (May 2024) vs select alternatives

DomainBenchmark
GPT-4o (May 2024)
OpenAI
May 13, 2024
Closed weights
GPT-4 Turbo (Apr 2024)
OpenAI
Apr. 9, 2024
Closed weights
Claude 3 Opus
Anthropic
Feb. 29, 2024
Closed weights
DeepSeek-V2 (MoE-236B, May 2024)
DeepSeek
May 7, 2024
Open weights
ECI scoreBest score 167
129127127125
Ranking#160#169#172#180
Conceptual reasoning
LMCABest score 68.2
16.6—17.0—
DTBenchBest score 99%
65%
n/a
62%
n/a
Long context
ForecastBenchBest score 62.5
57.759.458.4—
Mathematics
MATH Level 5Best score 98%
51%
47%
37%
n/a
OTIS Mock AIME 2024-2025Best score 100%
6%
7%
5%
n/a
Science
GPQA DiamondBest score 96%
49%
47%
47%
n/a
World knowledge
MMLUBest score 88%
84%
81%
85%
78%

Model metadata

General
OrganizationOpenAI
Release dateMay 13, 2024
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2023-10-01
Provider notesHello GPT-4o
Pricing
Input price$5 / 1M tokens
Output price$15 / 1M tokens
Training
ParametersUnknown
Training computeUnknown
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown