Cite this work as

              
                Robi Rahman (2024), "The pace of large-scale model releases is accelerating". Published online at epoch.ai. Retrieved from: 'https://epoch.ai/data-insights/large-scale-model-releases' [online resource]

BibTeX citation

@misc{epoch2024largescalemodelreleases,
  title={The pace of large-scale model releases is accelerating},
  author={Robi Rahman},
  year={2024},
  url={https://epoch.ai/data-insights/large-scale-model-releases},
  note={Accessed: }
}


            

The pace of large-scale model releases is accelerating

In 2017, only two models exceeded 10²³ FLOP in training compute. By 2020, this grew to four models; by 2022, there were 36, and by 2024, there were 201 models known to exceed 10²³ FLOP in our database, and 126 more with unconfirmed training compute that likely exceed 10²³ FLOP. As AI investment increases and training hardware becomes more cost-effective, models at this scale come within reach of more and more developers.

{"xAxis": {"label": "Publication date", "lim": [-0.8, 8.8], "scaleType": "linear", "ticks": [0, 1, 2, 3, 4, 5, 6, 7, 8], "tickLabels": ["2017", "2018", "2019", "2020", "2021", "2022", "2023", "2024", "2025"], "hideMinorGrid": true, "nice": false}, "yAxis": {"label": "Number of models", "lim": [0.0, 166.0], "scaleType": "linear", "ticks": [0.0, 20.0, 40.0, 60.0, 80.0, 100.0, 120.0, 140.0, 160.0, 180.0], "tickLabels": ["0", "20", "40", "60", "80", "100", "120", "140", "160", "180"], "hideMinorGrid": true}, "showLegend": true, "legendPosition": "header", "showFrame": false, "showXGrid": false, "tooltipType": "header-footer", "objects": [{"type": "bar", "color": "#00A5A6", "points": [{"x": 0.0, "y": 2.0, "tooltipData": {"2017": 2.0}}, {"x": 3.0, "y": 2.0, "tooltipData": {"2020": 2.0}}, {"x": 4.0, "y": 10.0, "tooltipData": {"2021": 10.0}}, {"x": 5.0, "y": 30.0, "tooltipData": {"2022": 30.0}}, {"x": 6.0, "y": 118.0, "tooltipData": {"2023": 118.0}}, {"x": 7.0, "y": 165.0, "tooltipData": {"2024": 165.0}}, {"x": 8.0, "y": 91.0, "tooltipData": {"2025": 91.0}}], "relativeBarWidth": 0.6}, {"type": "annotation", "text": "As of\nJuly\n2025", "x": 8, "y": 91, "ha": "center", "va": "bottom", "targetX": 8, "targetY": 91, "relDy": 0.02}], "additionalLegendItems": [], "addDataPadding": false, "title": "Number of models larger than 10<sup>23</sup> FLOP released by year", "originalDataAspectRatio": 0.7451612903225805}

Enable JavaScript to see an interactive visualization.

Authors

Robi Rahman

Published

June 19, 2024

Last updated

July 04, 2025

Explore this data

Data on Notable AI Models

Epoch AI's database contains over 900 notable ML models and 400 training compute estimates, offering a detailed exploration of trends in AI development.

Updated June 19, 2024

The pace of large-scale model releases is accelerating

Related insights

Explore this data

Data on Notable AI Models

We value your privacy