Language models compose the large majority of large-scale AI models

Out of 418 large-scale models with known compute, 326 are language models, of which 86 are vision-language models such as GPT-4. The first models trained with 1023 FLOP were for game-playing, but language has dominated since 2021. Other large-scale models have been developed for image and video generation, biological sequence modeling, and robotics.

Published

June 19, 2024

Last updated

July 04, 2025