Back to models

GPT-4o (Aug 2024)

ECI#166
127
OpenAI
Aug. 6, 2024
Closed weights

GPT-4o (Aug 2024) is a closed-weights model from OpenAI, released August 6, 2024. It has an ECI score of 127 and ranks 166th of 240 tracked models. At the time of its release, it ranked 4th of 69 tracked models.

GPT-4o (Aug 2024) vs select alternatives

DomainBenchmark
GPT-4o (Aug 2024)
OpenAI
Aug. 6, 2024
Closed weights
GPT-4o (May 2024)
OpenAI
May 13, 2024
Closed weights
Claude 3.5 Sonnet
Anthropic
Jun. 20, 2024
Closed weights
Llama 3.1-405B
Meta AI
Jul. 23, 2024
Open weights
ECI scoreBest score 173
127128130128
Ranking#166#161#157#162
Conceptual reasoning
SimpleBenchBest score 95%
18%
n/a
28%
23%
Mathematics
MATH Level 5Best score 98%
53%
51%
52%
50%
OTIS Mock AIME 2024-2025Best score 100%
6%
6%
7%
10%
Multimodal
Video-MMEBest score 80%
72%
n/a
60%
n/a
Science
GPQA DiamondBest score 97%
49%
49%
54%
51%
World knowledge
MMLUBest score 88%
84%
84%
87%
85%

Model metadata

General
OrganizationOpenAI
Release dateAug. 6, 2024
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2023-10-01
Provider notesHello GPT-4o
Pricing
Input price$2.50 / 1M tokens
Output price$10 / 1M tokens
Training
ParametersUnknown
Training computeUnknown
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown