Relative to their general Epoch Capabilities Index (ECI) values, Anthropic’s Claude models overperform on software engineering benchmarks (aggregated by the SWE-ECI) and underperform on math (Math-ECI). The SWE overperformance has been consistent across most generations, and remains in recent models. The math gap may be narrowing — Opus 4.6 and 4.7 both have Math-ECIs within 1 point of their general ECI, compared to larger gaps for earlier models.

These results come from our Domain-specific ECI Explorer, where you can view Math and SWE ECIs, or design your own variant. The ECI methodology compares performance relative to other large language models, and thus reflects how difficult tasks are on average for AIs, not how difficult they are for humans.