Back to models

Claude 2

ECI#189
120
Anthropic
Jul. 11, 2023
Closed weights

Claude 2 is a closed-weights model from Anthropic, released July 11, 2023. It has an ECI score of 120 and ranks 189th of 249 tracked models. At the time of its release, it ranked 3rd of 16 tracked models. At $8/Mtok for input tokens and $24/Mtok for output tokens, it is more expensive per token than similarly-capable models.

Input price$8 / 1M tokens
Output price$24 / 1M tokens
ParametersUnknown
Training compute3.9e24 FLOP

Claude 2 vs select alternatives

Reasoning
DomainBenchmark
Claude 2
Anthropic
Jul. 11, 2023
Closed weights
GPT-4 (Mar 2023)
OpenAI
Mar. 14, 2023
Closed weights
LLaMA-65B
Meta AI
Feb. 24, 2023
Open weights
Falcon-40B
Technology Innovation Institute
May 25, 2023
Open weights
ECI scoreBest score 166
120126110104
Ranking#189#173#216#227
Mathematics
OTIS Mock AIME 2024-2025Best score 100.0%
2.5%
0.6%
n/a
n/a
Science
GPQA DiamondBest score 95.8%
34.7%
35.7%
n/a
n/a
World knowledge
TriviaQABest score 87.5%
87.5%
n/a
86.0%
79.9%
MMLUBest score 88.1%
78.5%
86.4%
63.4%
56.9%

Model metadata

General
OrganizationAnthropic
Release dateJul. 11, 2023
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesanthropic.com
Pricing
Input price$8 / 1M tokens
Output price$24 / 1M tokens
Training
ParametersUnknown
Training compute3.9e24 FLOP
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown