Claude 3 Opus
ECI#172
127Claude 3 Opus is a closed-weights model from Anthropic, released February 29, 2024. It has an ECI score of 127 and ranks 172nd of 253 tracked models. At the time of its release, it ranked 1st of 51 tracked models.
Claude 3 Opus vs select alternatives
| Domain | Benchmark | Claude 3 Opus | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 127 | 120 | 126 | 122 | |
| Ranking | #172 | #192 | #175 | #188 | |
| Conceptual reasoning | LMCABest score 68.2 | 17.0 | — | 9.8 | — |
DTBenchBest score 99% | |||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 96% | ||||
| Software engineering | METR Time HorizonsBest score 17 hr 25 min | 3 min 57 sec | — | 5 min 22 sec | — |
| World knowledge | MMLUBest score 88% |
