AI Use in Math Research Documentation

MethodologyLimitationsChangelogDownloads
Show sidebarMethodology

Methodology

Epoch’s AI Use in Math Research explorer uses arXiv metadata and source text to track AI use acknowledgments in math preprints. We use AI models to read and classify the use cases of AI in papers that acknowledge its use, including research, writing, code and computation, literature review, and formalization. The data is available on the GitHub repository for this explorer.

Any questions, comments, or suggestions can be directed to math@epoch.ai.

Data

We use the metadata from all math papers that were posted to the arXiv preprint server from 1989 to the present day, and the source text from all such papers from 2023 to the present day. This data is compiled from three sources:

  1. arXiv metadata sourced from the arXiv OAI-PMH interface
  2. arXiv full-text data sourced from the arXiv Amazon S3 bulk data
  3. OpenAlex authorship information for each paper sourced from the OpenAlex API

Papers

We consider papers whose primary classification is math. Each paper is counted under the date that it was first submitted to arXiv; revision dates do not appear in this dataset. Each paper is counted in the subfield for its primary category only; secondary categories are not taken into account. We sourced the full text of the most recent available version of each paper as of September 5th, 2026. AI use acknowledgments added in revisions are counted under the date of the first version of the paper.

AI acknowledgment and use case classification

We say that a paper acknowledges AI use if it acknowledges the use of AI tools for any purpose. We further classify some specific use cases for which the authors acknowledged AI. We used the following process to identify AI use acknowledgments and classify the use cases.

  1. Each paper that contained at least one AI keyword was identified by a regex search. The list of AI keywords is in Table 1.
  2. GPT-5.6 Sol read the full text of every paper from 2023 to the present that had a keyword match and identified whether the paper contains an AI use acknowledgment. Sol tagged each such paper with the specific AI use cases acknowledged, using the list of tags in Table 2. A paper acknowledging several AI use cases received a tag for each use case. For each tag, Sol identified a passage in the paper that justifies its inclusion. The tag-passage pairs are stored and available with the data.
  3. The passages used to justify the tags were checked to ensure that they do appear in the paper using a string match. If the passage does not appear in the paper, the tag was removed from the paper.
  4. Claude Fable 5 independently read and tagged the use cases of every paper to which Sol assigned one of the research tags or the formalization tag.
  5. For every non-research tag, Fable read through the tag-passage pairs and judged whether the tag is supported or unsupported.
  6. We assigned the tags to use case categories as follows:
    • Substantial research: main_results_generated, specific_result_generated, statement_generated, substantial_proof_contributions
    • Research assistance: vague_proof_contributions, proof_ideas
    • Formalization: formalization_assist
    • Writing: writing_polish, draft_text_generated, translation
    • Code & computation: code_computation
    • Lit review: literature_search
  7. A paper is counted in the writing, code & computation, and lit review categories if Sol tagged the paper with a tag for the category and Fable supported the tag-passage pair.
  8. A paper is counted in the formalization category if Sol tagged the paper with formalization_assist and Fable also tagged the paper with formalization_assist on re-read.
  9. A paper is counted in the substantial research category if Sol assigned the paper a substantial research tag and Fable also assigned the paper a substantial research tag on re-read.
  10. A paper is counted in the research assistance category if Sol assigned the paper a research tag, Fable also assigned the paper a research tag on re-read, and the paper does not qualify for the substantial research category. In particular, the substantial research and research assistance categories are mutually exclusive, and the substantial research category only includes papers that both Fable and Sol tagged with a substantial research tag.
  11. A paper is counted as having an AI acknowledgment if it was tagged with any AI use case in step 2 and if Fable either supported a non-research use case tag-passage pair in step 5 or independently assigned a research use case tag in step 4.
  12. To estimate precision of the use case classification, an Epoch mathematician checked:
    • 200 research tag-passage pairs that passed the previous steps and agreed with 91% of tag-passage pairs, with a 93% research category agreement; and
    • 50 non-research tag-passage pairs that passed the previous steps and agreed with 98%.
  13. To estimate recall of the overall AI use acknowledgment rate, we asked GPT-5.6 Sol to identify AI use acknowledgments (with the same prompt as step 2) in 250 random papers from 2026 that did not have a keyword match in step 1. GPT-5.6 Sol identified an AI use acknowledgment in 0 of 250.

Independent work by Jin, Ke, and Sui used a similar methodology.

Providers

GPT-5.6 Sol identified all named AI tools (e.g., “OpenAI”, “Anthropic”, “Codex”, “Claude”, “ChatGPT”, etc.) during its read of the full-text source of papers with a keyword match in step 1 and stored the sentence in which the tool name is disclosed. Tool names were later matched to providers.

Established authors

Authorship information was parsed from arXiv metadata and matched to OpenAlex author records. In total, 91.5% of authors of papers appearing on arXiv from 2023 to the present matched to an OpenAlex author record as of September 16th, 2026. We consider an author an established author (for a subfield math.XX) if they satisfy each of the following criteria:

  1. Authored at least three papers (with primary subject math.XX) submitted to math arXiv between 2019 and 2022.
  2. Published at least five papers in core journals according to OpenAlex database records. (Core journals is an OpenAlex filter which consists of journals identified as a “core source” by the Centre for Science and Technology Studies at Leiden University.)
  3. Authored at least one paper submitted to any subfield of math arXiv since 2023.

A total of 29,399 people authored at least three papers submitted to arXiv between 2019 and 2022, and of those, 24,979 authored at least one paper submitted to arXiv since 2023 as of September 2026. Of the 24,979 authors satisfying criteria 1 and 3, we matched 24,906 to an OpenAlex author record, and 23,828 of those published at least five papers in core journals.

The established authors filter is intended to help track AI acknowledgment patterns among authors who consistently published math papers before commercial AI tools were common. It is not an assessment of mathematicians, and it is subject to the limitations of the methodology described here.

Appendix

Table 1. AI keywords

GroupKeywords
Generic termsAI, A.I., artificial intelligence, generative AI, GenAI, AI tool / assistant / model / system / chatbot / agent, AI-assisted, use of AI, large language model, language model, LLM
OpenAIChatGPT, GPT, GPT-4 / GPT-5 / GPT-4o, o3, o4, Codex, OpenAI
AnthropicClaude, Claude Code, Anthropic, Fable, Opus, Sonnet, Haiku
Google / DeepMindGemini, Deep Think, Gemma, DeepMind, AlphaProof, AlphaEvolve, AlphaGeometry, AlphaTensor, FunSearch, X-Evolve
Other model developersDeepSeek, Qwen, Kimi, Llama, Mistral, Grok
Coding assistantsGitHub Copilot, Copilot, Cursor, Devin
Mathematics AI systemsAxiomProver / Axiom Math, Aristotle, Rethlas, Danus, Eureka, TxGraffiti, DeepMath, AI proof assistant

Table 2. Use case tags

TagDefinitionCategory
main_results_generatedAI came up with the paper’s main results or the proof of the main theorems.Substantial research
specific_result_generatedA specific named or numbered result, proof, construction, bound, or counterexample in the paper is credited to AI.Substantial research
statement_generatedAI is credited with producing or suggesting the statement of a conjecture or theorem that is a main result.Substantial research
substantial_proof_contributionsAI is credited with a substantial, key, or essential contribution to a proof, at a level clearly sufficient for coauthorship.Substantial research
vague_proof_contributionsAI is credited with helping, assisting, or contributing to proofs, with language that is too weak to indicate a substantial contribution.Research assistance
proof_ideasAI is credited with minor proof assistance: brainstorming, testing ideas or intuitions, searching for examples, improving constants.Research assistance
math_checkingAI is credited with verifying proofs, constants, or derivations, or finding mathematical errors.Research assistance
formalization_assistAI assisted with formalizing the paper’s results.Formalization
code_computationAI helped write code or run a computation or simulation.Code and computation
literature_searchAI assisted with finding references, related work, or relevant known results.Literature review
writing_polishAI assisted with style, grammar, rephrasing, LaTeX or formatting, or textual proofreading.Writing
draft_text_generatedAI wrote substantial portions of the manuscript.Writing
translationAI assisted with translating the manuscript or sources between languages.Writing
figures_mediaAI assisted with generating figures, diagrams, artwork, or other media.not published
purpose_unstatedAI use is acknowledged, but no purpose is stated anywhere in the paper.not published
otherA genuine acknowledgment whose stated purpose fits no tag above.not published

Table 3. Non-use tags

TagDefinition
subject_matterThe paper is about AI, language models, or proof assistants. Such papers are excluded from the acknowledgment rate even if they also acknowledge AI use.
no_use_declaredThe authors explicitly state that they did not use AI for any use. Counted in a separate denial rate.
name_collisionThe matched term is a person’s name, an unrelated proper noun, or mathematical notation.
passing_mentionAn AI term appears in a citation, related work, or aside.