Back to models

Claude 2.1

ECI#198
119
Anthropic
Nov. 21, 2023
Closed weights

Claude 2.1 is a closed-weights model from Anthropic, released November 21, 2023. It has an ECI score of 119 and ranks 198th of 253 tracked models. At the time of its release, it ranked 5th of 35 tracked models.

Claude 2.1 vs select alternatives

DomainBenchmark
Claude 2.1
Anthropic
Nov. 21, 2023
Closed weights
Claude Instant
Anthropic
Aug. 9, 2023
Closed weights
GPT-4 (Mar 2023)
OpenAI
Mar. 14, 2023
Closed weights
Yi-34B
01.AI
Nov. 2, 2023
Open weights
ECI scoreBest score 169
119120126117
Ranking#198#194#180#206
Conceptual reasoning
DTBenchBest score 99%
51%
46%
n/a
n/a
Mathematics
OTIS Mock AIME 2024-2025Best score 100%
2%
n/a
1%
n/a
Science
GPQA DiamondBest score 96%
33%
n/a
36%
15%
World knowledge
MMLUBest score 88%
74%
73%
86%
76%

Model metadata

General
OrganizationAnthropic
Release dateNov. 21, 2023
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2023-01-01
Provider notesIntroducing Claude 2.1
Pricing
Input price$8 / 1M tokens
Output price$24 / 1M tokens
Training
ParametersUnknown
Training computeUnknown
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown