Back to models

Claude 2

ECI#191
117
Anthropic
Jul. 11, 2023
Closed weights

Claude 2 is a closed-weights model from Anthropic, released July 11, 2023. It has an ECI score of 117 and ranks 191st of 240 tracked models. At the time of its release, it ranked 3rd of 15 tracked models.

Claude 2 vs select alternatives

DomainBenchmark
Claude 2
Anthropic
Jul. 11, 2023
Closed weights
GPT-4 (Mar 2023)
OpenAI
Mar. 14, 2023
Closed weights
LLaMA-65B
Meta AI
Feb. 24, 2023
Open weights
Falcon-40B
Technology Innovation Institute
May 25, 2023
Open weights
ECI scoreBest score 173
11712210291
Ranking#191#180#211#221
Mathematics
OTIS Mock AIME 2024-2025Best score 100%
3%
1%
n/a
n/a
Science
GPQA DiamondBest score 97%
35%
36%
n/a
n/a
World knowledge
TriviaQABest score 88%
88%
n/a
86%
80%
MMLUBest score 88%
79%
86%
63%
57%

Model metadata

General
OrganizationAnthropic
Release dateJul. 11, 2023
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesanthropic.com
Pricing
Input price$8 / 1M tokens
Output price$24 / 1M tokens
Training
ParametersUnknown
Training compute3.9e24 FLOP
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown