Claude 3 Opus
ECI#172
126Claude 3 Opus is a closed-weights model from Anthropic, released February 29, 2024. It has an ECI score of 126 and ranks 172nd of 240 tracked models. At the time of its release, it ranked 1st of 45 tracked models.
Claude 3 Opus vs select alternatives
| Domain | Benchmark | Claude 3 Opus | |||
|---|---|---|---|---|---|
ECI scoreBest score 173 | 126 | 117 | 125 | 120 | |
| Ranking | #172 | #191 | #175 | #185 | |
| Conceptual reasoning | LMCABest score 70.6 | 17.0 | — | 9.8 | — |
DTBenchBest score 99% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 97% | ||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 3 min 57 sec | — | 5 min 22 sec | — |
| World knowledge | MMLUBest score 88% |
