An index aggregating many different benchmarks into a single, general capability scale.

A collection of unsolved problems from research mathematics, curated to be especially interesting and difficult.

A collection of problems posed or studied by mathematician Paul Erdős, open as of August 2026 and curated to be especially interesting and difficult.

A long-horizon coding benchmark. Models reimplement entire programs end-to-end, without access to the original source code.

A test of AI systems' learning capabilities, measuring whether their scores improve across repeated playthroughs of the relatively obscure game Earthborne Rangers.

100 positions from a puzzle-oriented variant of a well-known game, the details of which are deliberately left undisclosed.

100 novel puzzles, generated programmatically with a chess engine. Each puzzle has a single best next move.

1,000 factoid questions about politics, science and technology, art, sports, geography, music, and more.

Exceptionally difficult research-level math problems.

Expert-written math problems covering advanced undergrad through early career research.