Back to models

DeepSeek LLM 67B

ECI#219
111
DeepSeek
Nov. 29, 2023
Open weights

DeepSeek LLM 67B is an open-weights model from DeepSeek, released November 29, 2023. It has an ECI score of 111 and ranks 219th of 253 tracked models. At the time of its release, it ranked 14th of 37 tracked models.

DeepSeek LLM 67B vs select alternatives

DomainBenchmark
DeepSeek LLM 67B
DeepSeek
Nov. 29, 2023
Open weights
DeepSeek
Nov. 2, 2023
Open weights
OpenAI
Jan. 25, 2024
Closed weights
Google DeepMind
Dec. 13, 2023
Closed weights
ECI scoreBest score 167
11196116117
Ranking#219#241#211#207
Games
Chess PuzzlesBest score 72%
0%
n/a
0%
n/a
Mathematics
MATH Level 5Best score 98%
6%
n/a
12%
11%
OTIS Mock AIME 2024-2025Best score 100%
1%
n/a
2%
1%
Science
GPQA DiamondBest score 96%
25%
n/a
27%
34%

Model metadata