Back to models

Claude 2

ECI#193
120
Anthropic
Jul. 11, 2023
Closed weights

Claude 2 is a closed-weights model from Anthropic, released July 11, 2023. It has an ECI score of 120 and ranks 193rd of 253 tracked models. At the time of its release, it ranked 3rd of 16 tracked models.

Claude 2 vs select alternatives

DomainBenchmark
Claude 2
Anthropic
Jul. 11, 2023
Closed weights
GPT-4 (Mar 2023)
OpenAI
Mar. 14, 2023
Closed weights
LLaMA-65B
Meta AI
Feb. 24, 2023
Open weights
Falcon-40B
Technology Innovation Institute
May 25, 2023
Open weights
ECI scoreBest score 167
120126110104
Ranking#193#177#220#231
Mathematics
OTIS Mock AIME 2024-2025Best score 100%
3%
1%
n/a
n/a
Science
GPQA DiamondBest score 96%
35%
36%
n/a
n/a
World knowledge
TriviaQABest score 88%
88%
n/a
86%
80%
MMLUBest score 88%
79%
86%
63%
57%

Model metadata

General
OrganizationAnthropic
Release dateJul. 11, 2023
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesanthropic.com
Pricing
Input price$8 / 1M tokens
Output price$24 / 1M tokens
Training
ParametersUnknown
Training compute3.9e24 FLOP
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown