AI capabilities

AI systems can now write code, pass professional exams, and assist with scientific research, and their capabilities are improving remarkably fast. But measuring exactly what AI can and cannot do is genuinely difficult, with benchmarks struggling to keep pace and real-world performance often diverging from test scores. Epoch tracks AI capabilities across tasks and benchmarks, examining how fast progress is happening, how predictable it is, and what it reveals about where the technology is heading.

Filter

Type
AI Capabilities and Benchmarking Hub
Updated Sep. 5, 2026
AI Capabilities and Benchmarking Hub

Our database of benchmark results, featuring the performance of leading AI models on challenging tasks. It includes results from benchmarks evaluated internally by Epoch AI as well as data collected from external sources. Explore trends in AI capabilities across time, by benchmark, or by model.

The ECI frontier has advanced by 14 points per year since the introduction of reasoning models
Data Insight
Sep. 1, 2026
The ECI frontier has advanced by 14 points per year since the introduction of reasoning models

By Alexander Barry

Announcing FrontierMath Erdős
Update
Sep. 1, 2026
Announcing FrontierMath Erdős

A benchmark of 68 significant Erdős problems, open as of August 2026, curated by Thomas Bloom and formalized in Lean. AI systems must prove or disprove them within a fixed budget.

By Tom Adamczewski and Greg Burnham

9 big questions benchmarks can help answer
Newsletter
Aug. 14, 2026
9 big questions benchmarks can help answer

A good benchmark asks more than just “can AI do this specific task?”

By Greg Burnham

Disclosed CVEs: July Reached 5× the Pre-Mythos Record
Data Insight
Jul. 31, 2026
Disclosed CVEs: July Reached 5× the Pre-Mythos Record

Notable organizations disclosed ~2,500 high- and critical-severity CVEs in July 2026, about 5× the pre-Mythos monthly record. Epoch AI's updated breakdown of vulnerability disclosures following Anthropic's Project Glasswing.

By Luke Emberson

OpenAI accidentally hacked Hugging Face — should we have seen it coming?
Newsletter
Jul. 22, 2026
OpenAI accidentally hacked Hugging Face — should we have seen it coming?

Expert assessments and cyber benchmarks led us to expect that frontier models were capable of executing this kind of cyberattack

By Alexander Barry

AI detectors rarely flag human writing, but sometimes miss AI text imitating real authors
Data Insight
Jul. 15, 2026
AI detectors rarely flag human writing, but sometimes miss AI text imitating real authors

We tested Pangram, GPTZero, and Originality.ai on human and AI text. All three caught nearly every passage written from a simple prompt, but missed roughly one in five passages imitating a specific author's style.

By Jaeho Lee

Disclosed CVEs: 3.5× Spike After Claude Mythos
Data Insight
Jul. 2, 2026
Disclosed CVEs: 3.5× Spike After Claude Mythos

Notable organizations disclosed ~1,300 high- and critical-severity CVEs in June 2026, roughly 3.5× the pre-Mythos monthly record. Epoch AI's breakdown of vulnerability disclosures following Anthropic's Project Glasswing.

By Luke Emberson

GPT-4 led in ECI far longer than any other model
Data Insight
Jul. 2, 2026
GPT-4 led in ECI far longer than any other model

GPT-4 topped Epoch's Capabilities Index (ECI) for roughly a year after its March 2023 release — no model since has led for as long. The second-longest reign, by o1, lasted barely three months.

By Jaeho Lee

Can AI Learn From Experience? EBR-Bench Results
Report
Jul. 1, 2026
Can AI Learn From Experience? EBR-Bench Results

Frontier models show no improvement across 30 playthroughs of the board game Earthborne Rangers, scoring far below expert humans. Epoch AI's EBR-bench probes whether AI can learn on the fly.

By Benjamin Ou and Greg Burnham