GPT-4o mini | Epoch AI

ECI#177

124

OpenAI

Jul. 18, 2024

Closed weights

GPT-4o mini is a closed-weights model from OpenAI, released July 18, 2024. It has an ECI score of 124 and ranks 177th of 240 tracked models. At the time of its release, it ranked 7th of 64 tracked models.

GPT-4o mini vs select alternatives

Domain	Benchmark	GPT-4o mini OpenAI Jul. 18, 2024 Closed weights	GPT-4 (Mar 2023) OpenAI Mar. 14, 2023 Closed weights	GPT-4 Turbo (Nov 2023) OpenAI Jan. 25, 2024 Closed weights
	ECI scoreBest score 173	124	122	125
	Ranking	#177	#180	#175
Conceptual reasoning	LMCABest score 70.6	10.4	—	9.8
	DTBenchBest score 99%	54%	n/a	62%
Mathematics	GSM8KBest score 95%	91%	92%	n/a
	MATH Level 5Best score 98%	53%	n/a	40%
	OTIS Mock AIME 2024-2025Best score 100%	7%	1%	n/a
Science	GPQA DiamondBest score 97%	38%	36%	42%
World knowledge	MMLUBest score 88%	82%	86%	80%

Model metadata

General
Organization	OpenAI
Release date	Jul. 18, 2024
Model accessibility	Closed weights
Country	United States of America
Knowledge cutoff	2023-10-01
Provider notes	GPT-4o mini: advancing cost-efficient intelligence

Pricing
Input price	$0.15 / 1M tokens
Output price	$0.60 / 1M tokens

Training
Parameters	Unknown
Training compute	Unknown
Training hardware	Unknown
Training time	Unknown
Training dataset size	Unknown