AI scaling

The story of AI progress is dominated by scale. Training AI systems with more compute, power and data has consistently led to better performance. Epoch tracks the scale-up of the resources used to train AI systems, and what this means for capabilities and the future of AI. Epoch's research covers training compute trends, data availability, scaling laws, hardware constraints, and the question of whether scaling can continue through the end of the decade.

Filter

Type
AI models
Updated Nov. 4, 2026
AI models

Our public database, the largest of its kind, tracks over 3700 machine learning models from 1950 to today. Explore data and graphs showing the trajectory of AI.

Broadcom TPU compute shipments doubled from Q2 to Q3 2026, reaching 2 million H100-equivalents
Data Insight
Nov. 4, 2026
Broadcom TPU compute shipments doubled from Q2 to Q3 2026, reaching 2 million H100-equivalents

Broadcom’s shipments of TPU by unit volume increased by about 65% quarter over quarter to roughly 800,000 chips, while compute output doubled, driven by a shift to more powerful chips.

By Venkat Somala and Josh You

New global AI computing capacity is doubling every 9 months
Data Insight
Oct. 29, 2026
New global AI computing capacity is doubling every 9 months

The computing power of AI chips sold each quarter has grown about 2.5× per year since 2024, down from a surge in 2023.

By Isabel Juniewicz and Josh You

Long-context latency scales quadratically for GPT-5.6 but nearly linearly for Claude 5
Report
Sep. 8, 2026
Long-context latency scales quadratically for GPT-5.6 but nearly linearly for Claude 5

Epoch AI measures long-context latency scaling across four frontier models. GPT-5.6 Terra and Sol show quadratic time-to-first-token growth with context length, while Claude Sonnet 5 and Opus 5 stay near-linear.

By Jason Li

The record for computing capacity in a single data center has doubled every 7 months
Data Insight
Jun. 11, 2026
The record for computing capacity in a single data center has doubled every 7 months

Since Colossus 1 launched in August 2024, the record for the largest AI data center has doubled every seven months. Epoch AI's breakdown of single-site compute capacity trends through 2028.

By Ben Cottier

Is a compute crunch coming?
Newsletter
May 25, 2026
Is a compute crunch coming?

We estimated trends in global inference capacity and found that token demand appears to be growing much faster than supply.

By Luke Emberson and Jaime Sevilla

Frontier labs don't use most AI compute (yet)
Newsletter
May 20, 2026
Frontier labs don't use most AI compute (yet)

OpenAI, Anthropic, and xAI used just 20-30% of global AI compute in 2025, despite launching the AI boom. Epoch AI's analysis of frontier lab compute allocation and growth trajectories through 2027.

By Josh You

How fast could robot production scale up?
Report
Apr. 22, 2026
How fast could robot production scale up?

We look at reference classes, factory buildout timelines, and upstream component supply to estimate plausible production rates for humanoids, quadrupeds, robotic arms, wheeled robots, and drones.

By Jean-Stanislas Denain and Yann Rivière

Total AI chip memory bandwidth has grown 4.1x per year, now reaching 70 million terabytes per second
Data Insight
Mar. 24, 2026
Total AI chip memory bandwidth has grown 4.1x per year, now reaching 70 million terabytes per second

As of Q4 2025, memory bandwidth across global AI chips has reached roughly 70 million terabytes per second, enough to pass all data stored on the internet into memory in under an hour.

By Luke Emberson

Final training runs account for a minority of R&D compute spending
Newsletter
Mar. 23, 2026
Final training runs account for a minority of R&D compute spending

New evidence following the MiniMax and Z.ai IPOs

By Jean-Stanislas Denain and Cheryl Wu