AI Software Progress: Data & Research

Not all AI progress comes from throwing more and better hardware at the problem. Improvements to algorithms, data quality and training techniques can dramatically increase what AI systems are capable of, enabling models to reach the same capabilities with less computation. Epoch tracks these compute efficiency gains, often called algorithmic progress, over time, examining how quickly they are occurring, what is driving them, and what they mean for the pace of future AI progress.