The NVIDIA A100 has been the most popular hardware for training notable machine learning models
The NVIDIA A100 has been the most prolific hardware for highly-cited or state-of-the-art AI models identified in Epoch’s dataset, used for 65 notable ML models since its release. In second place is the NVIDIA V100, used to train 55 notable models, followed by Google’s TPU v3, used for 47.
However, we estimate that the NVIDIA H100 had sold more units than the A100 by late 2023, so it may be the most popular GPU for training models in the near future.
Epoch’s work is free to use, distribute, and reproduce provided the source and authors are credited under the Creative Commons BY license.