Search epoch.ai
Training compute costs are doubling every eight months for the largest AI models
Spending on training large-scale ML models is growing at a rate of 2.4x per year. The most advanced models now cost hundreds of millions of dollars, with expenses measured by amortizing cluster costs over the training period. About half of this spending is on GPUs, with the remainder on other hardware and energy.
Authors
Published
June 19, 2024
