Mock AIME 2024-2025 is a collection of problems from the OTIS Mock AIME exams from 2024 and 2025. The problems were written by students from the Olympiad Training for Individual Study (OTIS) program. The OTIS Mock AIME is an annual 3-hour exam consisting of 15 problems whose answers are integers between 0 and 999. As the name suggests, it is an unofficial exam intended to emulate the American Invitational Mathematics Exam.

The dataset contains 45 problems from 3 exams:

• 15 problems from Mock AIME 2024
• 15 problems from Mock AIME 2025 (I)
• 15 problems from Mock AIME 2025 (II)

These problems are harder than problems in MATH Level 5, but easier than the problems in FrontierMath.

For Mock AIME, we recommend using the log viewer as the best way to understand the evaluation settings (e.g. click here for o3-mini-2025-01-31).

We use the following prompt:

For the 3 questions among 45 which contain an image, we did not include the image as part of the input (this way all models are exposed to the same input, including those who don’t support images). However, we do include the TikZ or Asymptote code that generates the image as part of the input.

We use a model-based scorer that looks at the model’s submission and the true answer (which must be an integer between 0 and 999 inclusive), and returns whether the model’s final answer is correct. The model can still receive points for the question if its answer is not of the form “ANSWER: $ANSWER”, as long as the scorer model accepts it.