o3-mini | Epoch AI

ECI#111

140

OpenAI

Jan. 31, 2025

Closed weights

o3-mini is a closed-weights model from OpenAI, released January 31, 2025. It has an ECI score of 140 and ranks 111th of 253 tracked models. At the time of its release, it ranked 2nd of 109 tracked models.

o3-mini vs select alternatives

Domain	Benchmark	o3-mini OpenAI Jan. 31, 2025 Closed weights	o1 OpenAI Dec. 17, 2024 Closed weights	DeepSeek-R1 DeepSeek Jan. 20, 2025 Open weights	Gemini 2.0 Flash Thinking (Jan 2025) Google DeepMind Jan. 21, 2025 Closed weights
	ECI scoreBest score 167	140	142	139	135
	Ranking	#111	#102	#120	#136
Conceptual reasoning	ARC-AGI-2Best score 95%	3%	n/a	1%	n/a
	ARC-AGI-1Best score 99%	35%	31%	16%	n/a
Games	Chess PuzzlesBest score 72%	17%	15%	n/a	n/a
Mathematics	FrontierMath Tiers 1-3 (v2)Best score 94%	19%	15%	n/a	n/a
	MATH Level 5Best score 98%	96%	95%	93%	n/a
	OTIS Mock AIME 2024-2025Best score 100%	77%	73%	53%	58%
Science	GPQA DiamondBest score 96%	77%	77%	69%	57%
Software engineering	Aider PolyglotBest score 88%	60%	62%	57%	18%
World knowledge	SimpleQA VerifiedBest score 76%	15%	41%	n/a	n/a

Model metadata

General
Organization	OpenAI
Release date	Jan. 31, 2025
Model accessibility	Closed weights
Country	United States of America
Knowledge cutoff	2023-09-30
Provider notes	Pushing the frontier of cost-effective reasoning.

Pricing
Input price	$1.10 / 1M tokens
Output price	$4.40 / 1M tokens

Training
Parameters	Unknown
Training compute	Unknown
Training hardware	Unknown
Training time	Unknown
Training dataset size	Unknown