Search epoch.ai
Language models compose the large majority of large-scale AI models
Out of 366 large-scale models with known compute, 315 are language models, of which 73 are vision-language models such as GPT-4. The first models trained with 1023 FLOP were for game-playing, but language has dominated since 2021. Other large-scale models have been developed for image and video generation, biological sequence modeling, and robotics.
