Skip to main content
← Back to Blog

How Good Is Opus 4.8 For Cybersecurity?

Brandon Veiseh, Co-Founder & CEO at MindFort

Written by

Brandon Veiseh

AI Research2026-05-28·6 min read

Claude Opus 4.8, released by Anthropic on May 28, 2026, is a strong static code analysis assistant for security work, but it does not test software in runtime, which means it cannot confirm whether a vulnerability is actually exploitable against a live system.

Claude Opus 4.8 , released by Anthropic on May 28, 2026, is a strong static code analysis assistant for security work, but it does not test software in runtime, which means it cannot confirm whether a vulnerability is actually exploitable against a live system.

Is Opus 4.8 good at security?

Yes, as an analyst. It reads CVEs and patch diffs and tells you what's exploitable, catches auth bypasses, injection, broken access control, and business-logic bugs in code review, and drafts patches and threat models you can hand to an engineer. The real upgrade for that work is honesty: Anthropic reports 4.8 is about four times less likely than 4.7  to let flaws in its own code pass unremarked, with a tenfold-plus drop in overconfidence and the lowest hallucination rate of the models tested. A model that won't confidently call a non-exploitable finding exploitable is worth more in a SOC than one that's a few benchmark points smarter. The Cyber Verification Program from 4.7 is still the path for credentialed pros, and Trend Micro's TrendAI  is already evaluating 4.8 under it.

But be clear on what it's doing: reading code, not exercising your running app. This is static analysis with a smarter reader on top. It can say a sink looks reachable; it can't tell you whether that path is actually reachable in your deployed config, with real auth state and live data flows. That gap is where the false positives (exploitable-looking in source, not in reality) and the false negatives (bugs that only appear when components interact at runtime) live, and a static read never sees them.

Where does Opus 4.8 land on MindFort's NexBench?

We put Opus 4.8 through NexBench, MindFort's internal evaluation, alongside eleven other models. Each one runs an authorized full-breadth web-app pen test against a controlled target, and an independent GPT-5.5 validator reproduces every finding before it counts toward the score.

The number below describes Opus 4.8 in a harness, not Opus 4.8 alone, and the distinction matters. NexBench drops every model into a portable version of MindFort's production agent system: browser and sandbox access inside an isolated container, a manager that scopes the engagement, and subagents it delegates to. A frontier model handed nothing but a prompt and a URL does almost none of this work. What the score grades is the model's decision-making in both roles, as the executor running the attack and the manager choosing where to send effort, along with how efficiently it turns tokens into findings that hold up under reproduction.

Opus 4.8 finished third of twelve. At its max reasoning effort it scored 45, behind GPT-5.6 Sol (61) and Grok 4.5 (52), and 68 of its findings survived validation, the second-highest count in the entire field. That second number is the one that fits its reputation as an analyst: Opus surfaces a lot, and a high share of what it surfaces holds up under reproduction. The live NexBench standings carry the current board, including models added since this run.

Fig. 1

Best NexBench score, every model on the board

Highest validator-accepted score each model reached at any reasoning effort. Opus 4.8 lands third, highlighted here against the field.

Grok 4.6
Grok 4.7
GPT-5.6 Sol
Grok 4.5
Claude Opus 4.8
GPT-5.6 Luna
Kimi K3
GPT-5.5
GPT-5.6 Terra
GLM-5.2
Claude Sonnet 5
GLM-5.3
GLM-5.3 Flash
Qwen3.8 27B
Kimi K2.7
Nemotron 3 Ultra
Mercury 2.5 Preview
Best validator-accepted score across every reasoning-effort run = 114= 114
Best validator-accepted score across every reasoning-effort run = 70= 70
Best validator-accepted score across every reasoning-effort run = 61= 61
Best validator-accepted score across every reasoning-effort run = 52= 52
Best validator-accepted score across every reasoning-effort run = 45= 45
Best validator-accepted score across every reasoning-effort run = 43= 43
Best validator-accepted score across every reasoning-effort run = 42= 42
Best validator-accepted score across every reasoning-effort run = 41= 41
Best validator-accepted score across every reasoning-effort run = 36= 36
Best validator-accepted score across every reasoning-effort run = 34= 34
Best validator-accepted score across every reasoning-effort run = 34= 34
Best validator-accepted score across every reasoning-effort run = 33= 33
Best validator-accepted score across every reasoning-effort run = 29= 29
Best validator-accepted score across every reasoning-effort run = 28= 28
Best validator-accepted score across every reasoning-effort run = 24= 24
Best validator-accepted score across every reasoning-effort run = 18= 18
Best validator-accepted score across every reasoning-effort run = 6= 6
075150
114
70
61
52
45
43
42
41
36
34
34
33
29
28
24
18
6
Fig. 2

NexBench leaderboard, by accepted findings

Sorted by total validator-accepted findings. Opus 4.8 is second only to GPT-5.6 Sol on volume. Sort any column to re-rank.

ModelBest-run effort
GPT-5.6 SolX-High6152h 19m8740$1,093224.5M0.1760.855
Claude Opus 4.8Max4551h 50m6838$38077.8M0.4132.019
Claude Sonnet 5Max3454h 30m5431$374173.1M0.3480.751
Grok 4.5High5235h 3m5126$12249.6M0.9702.378
GPT-5.6 TerraX-High3651h 6m4919$21580.3M0.4891.308
GPT-5.6 LunaX-High4351h 59m4721$158127.8M0.6330.782
GPT-5.5X-High4151h 19m4519$12088.0M0.8171.114
Qwen3.8 27BDefault28359m459$516.8M1.53811.533
Grok 4.6X-High11411h 57m4426$3925.4M2.9514.485
Kimi K3Default42349m4122$4740.0M2.0002.349
GLM-5.2X-High3421h 40m3112$3842.7M1.7221.522
Grok 4.7X-High7011h 17m2620$4435.3M1.6091.986
GLM-5.3Max3321h 17m2515$3040.6M2.0441.528
GLM-5.3 FlashMax2923h 24m2211$1939.4M2.6611.268
Nemotron 3 UltraHigh1825h 3m162$92261.5M0.2920.103
Kimi K2.7Default2412h 32m142$1417.3M1.7241.387
Mercury 2.5 PreviewHigh611h 6m31$720.1M0.8050.299

Opus is not the cheapest way to reach that score. It runs at max effort for its best result, which costs both tokens and wall-clock time. Plotting score against cost per run shows where it sits: strong on the score axis, toward the pricier end on cost.

Fig. 3

Score vs. cost per run

Every model-effort run in NexBench by standard cost against score, except Opus 4.8, which is shown at its best run only (45 for $155). The rest of the field is grayed out.

0306090120150$0$110$220$330$440$550Standard cost (USD)ScoreClaude Opus 4.8 · max
Claude Opus 4.8
Claude Sonnet 5
GLM-5.2
GPT-5.5
GPT-5.6 Sol
GPT-5.6 Luna
GPT-5.6 Terra
Grok 4.5
Kimi K2.7
Kimi K3
Nemotron 3 Ultra
Qwen3.8 27B
GLM-5.3
GLM-5.3 Flash
Mercury 2.5 Preview
Grok 4.6
Grok 4.7

Is Opus 4.8 better than Mythos?

No, and it's not meant to be. The runtime safeguards that block prohibited or high-risk cyber prompts are still on, and the system card frames those safeguards, not raw capability, as what closes the practical gap between 4.8 and Mythos. Don't expect 4.8 to chain a multi-stage exploit against a live target or autonomously find unknown bugs at scale. It's trained not to.

Mythos does exactly that, and it's nearly here. Under Project Glasswing , partners found more than 10,000 vulnerabilities in a month, including 6,202 high- or critical-severity flaws across 1,000 open-source projects. Two weeks ago, researchers at a Palo Alto, Calif., security firm used Mythos Preview to chain two macOS bugs into a privilege-escalation exploit that bypassed Apple's Memory Integrity Enforcement on M5 silicon, as The Wall Street Journal reported . That capability was locked behind a dozen partners; Anthropic now says it's weeks from general release, so defenders and adversaries get it at roughly the same time. When we covered 4.7, that model was walled off entirely, and 4.8 is the moment the wall starts coming down. We cover the full defender playbook in What Is Claude Mythos? Why Security Teams Need to Act Now.

But notice what those numbers are: bugs flagged by reading code, not exploits proven against a running system. Grade hundreds of thousands of lines and a model can't hold every cross-service interaction, runtime state, and auth path in context at once, and that's exactly where most real vulnerabilities live. So you get a flood of plausible findings a human still has to triage and disprove, plus the dangerous ones that only surface at runtime and never show up in a static pass. AISI even noted its Mythos evals ran without live defenders, EDR, or active incident response. Ten thousand findings is a triage problem, not a security outcome.

CapabilityOpus 4.8 (static reader)Claude Mythos (autonomous)MindFort AXR
Reads code, CVEs, patch diffsYesYesYes
Drafts patches and threat modelsYesYesYes (as merge-ready PRs)
Confirms exploitability at runtimeNoNo (findings are code-flagged, not run-proven)Yes (reproduces the exploit live)
Autonomous multi-stage exploit chainingNo (trained not to)YesYes
AvailabilityGenerally availableGated, weeks from releaseAvailable now

Source: capability framing per Anthropic's Opus 4.8 release  and system card; Mythos discovery figures via Project Glasswing ; MindFort capabilities per MindFort's product.

What should security teams actually do now?

Opus 4.8 is not a replacement for testing your software in runtime. It reads code, it doesn't run attacks against your live system, so it can't tell you which of its findings actually hold once the app is deployed, authenticated, and handling real traffic. Treating a model's code review as a security test means shipping on unproven findings while the bugs that only exist at runtime go untouched.

That's what MindFort is: autonomous security agents that find vulnerabilities and fix them continuously, across every surface. The difference from a model reading your code is that our agents work against your running application. They probe your apps, APIs, and infrastructure the way an attacker would, run the exploit in runtime to reproduce it before anything reaches you, and ship each proven finding back as a verified patch PR you can merge. It's a new category we call AXR (Autonomous Exploitation and Remediation). For how to evaluate vendors, see our 2026 AI Pen Testing Buyer's Guide. You don't need Mythos access to defend against Mythos-class discovery; you need a system that proves what's exploitable and fixes it, not one that hands you ten thousand maybes.

FAQ

Is Claude Opus 4.8 good at security?

Yes, as an analyst. Opus 4.8 reads CVEs and patch diffs, catches auth bypasses, injection, broken access control, and business-logic bugs in code review, and drafts patches and threat models. Anthropic reports it is about four times less likely than 4.7 to let flaws in its own code pass unremarked, with a tenfold-plus drop in overconfidence and the lowest hallucination rate of any tested model.

Is Opus 4.8 better than Claude Mythos?

No, and it is not meant to be. The runtime safeguards that block prohibited or high-risk cyber prompts are still on, and Anthropic's system card frames those safeguards, not raw capability, as what closes the practical gap between 4.8 and Mythos. Opus 4.8 is trained not to chain multi-stage exploits against live targets or autonomously discover unknown bugs at scale.

Can Opus 4.8 replace runtime security testing?

No. Opus 4.8 is a smarter static code reader, not a runtime tester. It can say a sink looks reachable, but it cannot tell you whether that path is actually reachable in your deployed config, with real auth state and live data flows. False positives that look exploitable in source and false negatives that only appear at runtime both live in that gap.

What should security teams do now that Opus 4.8 is out?

Use Opus 4.8 for code review, patch drafting, and threat modeling, but pair it with runtime testing against your live application. Static findings without runtime validation become a triage firehose, and the bugs that only exist at runtime stay untouched. Continuous, validation-first testing is what proves which findings actually hold once the app is deployed and authenticated.

How does MindFort compare to using Opus 4.8 directly?

MindFort runs autonomous security agents against your running application instead of just reading your code. The agents probe your apps, APIs, and infrastructure the way an attacker would, reproduce the exploit in runtime, and ship each proven finding back as a verified patch PR. The category is AXR (Autonomous Exploitation and Remediation).

About the author

Brandon Veiseh, Co-Founder & CEO at MindFort

Brandon Veiseh

Co-Founder & CEO · MindFort

Founded his first startup building NLP models for network packet inspection. Led product at ProjectDiscovery, built their enterprise platform from scratch. At NetSPI, led development of AI tools for offensive security.

An Autonomous Security Agent.

Agents find vulnerabilities and fix them for you.

Book a demo with our team.

First Results

Hours

Coverage

24/7

False Positives

<1%

Setup

Minutes