Z.ai’s GLM-5.3 is the highest-scoring open-weight model on the Cyber ECI, a cybersecurity-focused version of our Epoch Capabilities Index (ECI). Its score of 160 is above that of OpenAI’s GPT-5.4, released in March 2026. However, it still trails Claude Mythos Preview and GPT-5.5, both from April 2026. This places the open cyber frontier roughly where the closed frontier stood 6–7 months ago.
| Model | Organization | Release date | Model accessibility | Weights | Cyber ECI | Cyber ECI 90% interval (low) | Cyber ECI 90% interval (high) | Cyber benchmark results |
|---|---|---|---|---|---|---|---|---|
| GPT-3.5 Turbo (Jun 2023) | OpenAI | 2023-06-13 | API access | Closed weights | 112.21 | 89.55 | 118.96 | 2 |
| Claude 3 Opus | Anthropic | 2024-02-29 | API access | Closed weights | 126.45 | 121.59 | 132.42 | 6 |
| GPT-4 Turbo (Apr 2024) | OpenAI | 2024-04-09 | API access | Closed weights | 124.51 | 119.10 | 129.17 | 2 |
| Llama 3-70B | Meta AI | 2024-04-18 | Open weights (restricted use) | Open weights | 129.24 | 106.73 | 132.59 | 2 |
| GPT-4o (May 2024) | OpenAI | 2024-05-13 | API access | Closed weights | 126.74 | 120.81 | 133.59 | 9 |
| Claude 3.5 Sonnet | Anthropic | 2024-06-20 | API access | Closed weights | 137.33 | 133.85 | 139.84 | 3 |
| o1 | OpenAI | 2024-12-17 | API access | Closed weights | 139.72 | 132.35 | 141.56 | 4 |
| DeepSeek-R1 | DeepSeek | 2025-01-20 | Open weights (unrestricted) | Open weights | 133.97 | 112.10 | 137.46 | 3 |
| Claude 3.7 Sonnet | Anthropic | 2025-02-24 | API access | Closed weights | 139.79 | 136.56 | 142.49 | 6 |
| o3 | OpenAI | 2025-04-16 | API access | Closed weights | 145.80 | 142.22 | 147.89 | 8 |
| o4-mini | OpenAI | 2025-04-16 | API access | Closed weights | 144.19 | 131.67 | 147.14 | 2 |
| Claude Opus 4 | Anthropic | 2025-05-22 | API access | Closed weights | 144.73 | 142.30 | 146.69 | 8 |
| Claude Sonnet 4 | Anthropic | 2025-05-22 | API access | Closed weights | 143.82 | 141.29 | 146.95 | 3 |
| DeepSeek-R1 (May 2025) | DeepSeek | 2025-05-28 | Open weights (unrestricted) | Open weights | 139.99 | 135.06 | 142.23 | 3 |
| Gemini 2.5 Pro (Jun 2025) | Google DeepMind | 2025-06-05 | API access | Closed weights | 141.45 | 138.20 | 146.51 | 2 |
| Claude Opus 4.1 | Anthropic | 2025-08-05 | API access | Closed weights | 145.81 | 143.20 | 148.60 | 3 |
| gpt-oss-120b | OpenAI | 2025-08-05 | Open weights (unrestricted) | Open weights | 143.13 | 139.70 | 145.29 | 3 |
| GPT-5 | OpenAI | 2025-08-07 | API access | Closed weights | 149.43 | 147.32 | 150.25 | 12 |
| GPT-5 mini | OpenAI | 2025-08-07 | API access | Closed weights | 145.15 | 142.71 | 146.91 | 4 |
| DeepSeek-V3.1 | DeepSeek | 2025-08-21 | Open weights (unrestricted) | Open weights | 140.23 | 134.01 | 142.43 | 5 |
| Claude Sonnet 4.5 | Anthropic | 2025-09-29 | API access | Closed weights | 149.16 | 147.30 | 150.86 | 10 |
| Claude Haiku 4.5 | Anthropic | 2025-10-15 | API access | Closed weights | 150.78 | 125.68 | 153.88 | 4 |
| Kimi K2 Thinking | Moonshot | 2025-11-06 | Open weights (restricted use) | Open weights | 142.66 | 138.99 | 145.39 | 2 |
| GPT-5.1 Codex Max | OpenAI | 2025-11-19 | API access | Closed weights | 153.70 | 149.95 | 155.19 | 7 |
| Claude Opus 4.5 | Anthropic | 2025-11-24 | API access | Closed weights | 152.90 | 150.84 | 155.11 | 10 |
| GPT-5.2 Codex | OpenAI | 2025-12-18 | API access | Closed weights | 154.19 | 151.72 | 155.91 | 11 |
| Claude Opus 4.6 | Anthropic | 2026-02-05 | API access | Closed weights | 157.99 | 155.75 | 160.43 | 15 |
| GPT-5.3 Codex | OpenAI | 2026-02-05 | API access | Closed weights | 156.80 | 154.47 | 159.21 | 12 |
| GLM-5 | Z.ai (Zhipu AI) | 2026-02-11 | Open weights (unrestricted) | Open weights | 147.95 | 143.22 | 151.71 | 2 |
| Claude Sonnet 4.6 | Anthropic | 2026-02-17 | API access | Closed weights | 154.21 | 149.91 | 157.50 | 4 |
| Gemini 3.1 Pro | Google DeepMind | 2026-02-19 | API access | Closed weights | 153.55 | 150.17 | 155.97 | 3 |
| GPT-5.4 | OpenAI | 2026-03-05 | API access | Closed weights | 157.04 | 155.04 | 159.55 | 13 |
| Claude Mythos Preview (Early) | Anthropic | 2026-04-06 | Unreleased | Closed weights | 162.15 | 158.98 | 166.37 | 6 |
| Claude Mythos Preview (April) | Anthropic | 2026-04-07 | Limited access | Closed weights | 164.82 | 161.81 | 169.99 | 12 |
| GLM-5.1 | Z.ai (Zhipu AI) | 2026-04-07 | Open weights (unrestricted) | Open weights | 152.91 | 144.48 | 155.28 | 2 |
| Muse Spark | Meta AI | 2026-04-08 | API access | Closed weights | 137.32 | 130.55 | 144.53 | 2 |
| GPT-5.4-Cyber | OpenAI | 2026-04-14 | Limited access | Closed weights | 156.40 | 153.88 | 159.41 | 2 |
| Claude Opus 4.7 | Anthropic | 2026-04-16 | API access | Closed weights | 154.94 | 152.97 | 157.00 | 6 |
| GPT-5.5 | OpenAI | 2026-04-23 | API access | Closed weights | 162.22 | 159.13 | 166.79 | 14 |
| DeepSeek-V4-Pro | DeepSeek | 2026-04-24 | Open weights (unrestricted) | Open weights | 150.35 | 148.00 | 152.37 | 3 |
| GPT-5.5-Cyber | OpenAI | 2026-05-07 | Limited access | Closed weights | 163.84 | 160.50 | 169.93 | 2 |
| Claude Opus 4.8 | Anthropic | 2026-05-28 | API access | Closed weights | 158.78 | 155.83 | 163.10 | 3 |
| Claude Mythos 5 | Anthropic | 2026-06-09 | Limited access | Closed weights | 168.27 | 164.19 | 178.45 | 4 |
| GLM-5.2 | Z.ai (Zhipu AI) | 2026-06-16 | Open weights (unrestricted) | Open weights | 154.12 | 151.72 | 156.46 | 4 |
| Claude Sonnet 5 | Anthropic | 2026-06-30 | API access | Closed weights | 155.49 | 135.27 | 158.39 | 4 |
| GPT-5.6 Sol | OpenAI | 2026-07-09 | API access | Closed weights | 166.46 | 162.98 | 171.33 | 10 |
| Kimi K3 | Moonshot | 2026-07-16 | Open weights (non-commercial) | Open weights | 157.60 | 147.96 | 160.67 | 4 |
| Claude Opus 5 | Anthropic | 2026-07-24 | API access | Closed weights | 167.47 | 162.97 | 171.59 | 4 |
| GLM-5.3 | Z.ai (Zhipu AI) | 2026-08-14 | Open weights (restricted use) | Open weights | 160.10 | 155.83 | 166.97 | 3 |
| Claude Mythos 5.1 | Anthropic | 2026-09-01 | Limited access | Closed weights | 169.60 | 165.42 | 174.63 | 4 |
| GPT-6 Astra | OpenAI | 2026-09-03 | API access | Closed weights | 171.03 | 166.93 | 177.96 | 7 |
| Claude Opus 5.5 | Anthropic | 2026-09-22 | API access | Closed weights | 171.14 | 166.66 | 177.32 | 4 |
| GPT-6 Sol | OpenAI | 2026-09-22 | API access | Closed weights | 164.17 | 155.03 | 167.46 | 3 |
| GPT-6 Luna | OpenAI | 2026-09-22 | API access | Closed weights | 157.31 | 109.15 | 159.86 | 2 |
| Claude Sonnet 5.5 | Anthropic | 2026-09-28 | API access | Closed weights | 167.34 | 163.26 | 171.68 | 4 |
| GPT-6.1 Sol | OpenAI | 2026-09-29 | API access | Closed weights | 168.89 | 164.89 | 174.78 | 3 |
| Claude Haiku 5.5 | Anthropic | 2026-10-07 | API access | Closed weights | 158.88 | 144.61 | 161.77 | 4 |
The closed-weight frontier has also continued to advance, currently led by Anthropic’s Claude Opus 5.5 and OpenAI’s GPT-6 Astra, both with a Cyber ECI of 171.
Epoch's work is free to use, distribute, and reproduce provided the source and authors are credited under the Creative Commons BY license.
Learn more about this graph
We compare open- and closed-weight models using the Cyber ECI, a domain-specific version of the Epoch Capabilities Index (ECI) based on cybersecurity benchmarks. We keep the benchmark parameters from a joint fit of the ECI on general and cyber benchmarks, and estimate each model’s Cyber ECI from its cyber results alone. Scores are on the same scale as the general ECI. See our documentation for details on the methodology.
Data
We use Cyber ECI data as of October 8, 2026. The October update expanded the index from 56 to 76 models and from 20 to 35 cybersecurity benchmarks, for a total of 324 model–benchmark results. These come from the UK AI Security Institute (AISI), CAISI, the AI cyber-evaluations company Irregular, reports by model developers, and other public sources. Three of the seven CAISI benchmarks come from its September 2026 assessment of GLM-5.3 and are the only cyber results available for that model.
We include the 57 models with at least two cyber benchmark results, as in the default view of our explorer. The Cyber ECI scores are available to download below, and the underlying benchmark results are available as a CSV.
Analysis
For each group, we connect the models that scored higher than every earlier model in that group at release. Open-weight models include those released under restricted-use or non-commercial licenses. Closed-weight models include limited-access and unreleased models, such as Claude Mythos 5 and an early checkpoint of Claude Mythos Preview. In the text, Mythos Preview refers to its April 7, 2026 checkpoint.
We compare models by their central estimates. While the Cyber ECI scores in our data explorer currently include 90% confidence intervals for each model, we anticipate methodology changes soon that will let us better estimate uncertainty in differences between models.
To estimate the current lag, we identify the release dates of the closed-weight models whose scores most closely bracket those of GLM-5.3, the highest-scoring open-weight model. GPT-5.4, released on March 5, 2026, scores below GLM-5.3, and Mythos Preview, released on April 7, 2026, scores above it. As of our data cutoff, these releases were 7 and 6 months earlier, respectively.
Assumptions and limitations
- Few results per model. GLM-5.3’s score comes from three CAISI benchmark results, and Opus 5.5’s from four benchmarks reported by Anthropic. Opus 5.5 and Astra do not share any benchmarks, and their confidence intervals overlap almost entirely.
- Inferred model identities. CAISI did not name the US models it evaluated, so we attributed those results to the models we judge most likely to have been leading at the time, such as GPT-6 Astra and Claude Mythos Preview.
- Scores move with refits. The October refit lowered several of the highest scores: Claude Mythos 5 fell by 3.9 points and GPT-5.6 Sol by 4.7. Cyber ECI values in our earlier publications are therefore not directly comparable to the new values.
- Coverage. We include only models with at least two cyber benchmark results, so some recent open-weight models with a general ECI do not appear.

