Viewpoint
Apr. 26, 2023

Please report your compute

Compute is essential for AI performance, but researchers often fail to report it. Adopting reporting norms would support research, enhance forecasts of AI’s impacts and developments, and assist policymakers.

By Jaime Sevilla, Anson Ho, and Tamay Besiroglu

We’ve recently published an opinion piece in the Communications of the ACM, where we ask machine learning researchers and engineers to consistently report their compute usage.

If this norm was widely adopted, it would allow us to better discern to what degree improvements in AI have been driven by scale rather than novel algorithms, it would help forecast the emergence of novel AI capabilities and it would provide a tangible lever around which external and internal regulation could be developed.

To facilitate the estimation and reporting of compute usage, we have prepared an interactive calculator that you can find in our report Estimating Training Compute of Deep Learning Models.

You can read the opinion piece here.

About the authors

Jaime Sevilla's avatar
Jaime Sevilla
Jaime Sevilla is the co-founder and director of Epoch AI. His research is focused on technological forecasting and the trajectory of AI. He has a background in Mathematics and Computer Science.
Anson Ho's avatar
Anson Ho
Anson Ho is a researcher at Epoch AI. He is interested in helping develop a more rigorous understanding of future developments in AI and its societal impacts.
Tamay Besiroglu's avatar
Tamay Besiroglu
Tamay Besiroglu co-founded Epoch AI and remains contributing to the organization as a research advisor. He left Epoch to co-lead Mechanize, a startup building virtual work environments, benchmarks, and training data for AI development. His research expertise focuses on the economics of computing and broader trends in machine learning.