Language models compose the large majority of large-scale AI models

Out of 280 large-scale models with known compute, 245 are language models, of which 35 are vision-language models such as GPT-4. The first models trained with 10²³ FLOP were for game-playing, but language has dominated since 2021. Other large-scale models have been developed for image and video generation, biological sequence modeling, and robotics.