Jason Li
Jason Li is a researcher at Epoch AI, where he studies topics related to AI inference. Before Epoch, he worked at NVIDIA on LLM serving and inference optimization.
Jason Li is a researcher at Epoch AI, where he studies topics related to AI inference. Before Epoch, he worked at NVIDIA on LLM serving and inference optimization.
Epoch AI measures long-context latency scaling across four frontier models. GPT-5.6 Terra and Sol show quadratic time-to-first-token growth with context length, while Claude Sonnet 5 and Opus 5 stay near-linear.