head-to-head

MetricClaude Opus 5DeepSeek V4 Flash
SWE-bench Verified97.0%88.8%
SWE-bench Pro
Terminal-Bench82.7 (TB2.1, vendor)
Input $ / 1M$5$0.14
Output $ / 1M$25$0.28
Context1M
Open weightsNoYes
AccessAPI (claude-opus-5) · Claude Code · Claude Cowork · claude.ai (Pro, Max)Open weights (MIT) · API (deepseek-v4-flash) · self-host
MakerAnthropicDeepSeek

what do the benchmarks actually say?

On SWE-bench Verified — real, human-validated GitHub issues resolved end-to-end — Claude Opus 5 posts 97.0% against 88.8% for DeepSeek V4 Flash, a 8.2-point gap. Verified is the closest public proxy for "can it fix a real bug in a real repo without help", which is why it anchors our ranking.

A few points either way is real but not decisive: within that band, the agent scaffolding around the model — how it retrieves files, runs tests, and retries — often matters as much as the base model. Treat the gap as a lean, not a verdict.

which is cheaper to run?

DeepSeek V4 Flash is the cheaper model: $0.14 per 1M input tokens ($0.28 output) versus $5 ($25 output) for Claude Opus 5 — roughly 35.7× less on input. Coding workloads are output-heavy — agents write diffs, tests and retries — so weight the output rate more than the input rate when you estimate a monthly bill.

DeepSeek V4 Flash ships open weights. Beyond the per-token discount, that means you can self-host it, fine-tune it, pin a snapshot so the model can't change under you, and keep code on your own infrastructure — none of which is possible with Claude Opus 5, which is API-only. For teams with compliance constraints that difference outweighs any benchmark point.

when to pick each

Pick Claude Opus 5 if

The highest independently measured coding score on the board at 97.0%, at half the price of Fable 5. Strongest on short and medium tasks, though GPT-5.6 Sol still edges it on multi-hour work.

Pick DeepSeek V4 Flash if

The cheapest model making a near-frontier agentic claim: 284B MoE with 13B active, 1M context, and native Responses API plus Codex support at $0.28 per 1M output.

how were these scores verified?

We only print a number once it's confirmed against a primary source or an independent evaluation, and each row on our leaderboard records which kind it is:

  • Claude Opus 5: Independent (vals.ai, observed Jul 25 2026, mini-swe-agent bash-only harness): SWE-bench Verified 97.00% ±0.76, the highest score on the board and 1st of the 75 systems vals.ai has run. Entered ranked Jul 25, 2026 after one day unranked: Anthropic published no SWE-bench Verified number at launch and still has not, so this is vals.ai's own measurement rather than a vendor claim. Read the #1 as a three-way tie, not a win — GPT-5.6 Sol is at 96.20% ±0.86 (a 0.8-point gap, ~0.7 sigma) and Claude Fable 5 at 95.00% ±0.98 (2.0 points, ~1.6 sigma), both inside the combined margin of error. We rank Opus 5 first only because it scored highest. Where the top two genuinely separate is task length, and not in Opus 5's favour: on the 1-to-4-hour tier Sol solves 98% against Opus 5's 90%, while Opus 5 leads on shorter work (98% under 15 minutes and 97% on 15-minute-to-1-hour tasks, vs 97% and 95% for Sol). Released Jul 24, 2026 at $5/$25 per 1M, the same price as Opus 4.8 and half of Fable 5. Anthropic's launch claims stay unreproducible (Frontier-Bench v0.1, CursorBench 3.2 and Zapier AutomationBench are proprietary), so this is the first externally checkable score the model has. Fast mode runs about 2.5x default speed at 2x base price.
  • DeepSeek V4 Flash: Independent (vals.ai, Aug 5 2026, mini-swe-agent bash-only harness): SWE-bench Verified 88.8%, for the DeepSeek-V4-Flash-0731 build, matching the checkpoint DeepSeek own change log describes. Ranks above Claude Opus 4.8 (88.6%) and below GPT-5.6 Luna (93.0%). Vendor-reported agent numbers for the same build (DeepSeek change log, Jul 31 2026): Terminal-Bench 2.1 82.7, Cybergym 76.7, Toolathlon verified 70.3, DeepSWE 54.4, NL2Repo 54.2, Agent Last Exam 25.2, produced with DeepSeek own unreleased "DeepSeek Harness minimal mode" and not independently reproduced. The V4-Flash-Preview model card (pre-0731 weights) separately listed SWE-bench Verified 79.0 and Terminal-Bench 2.0 56.9; those are not carried over. Same architecture and size as the preview (284B total / 13B active, FP4+FP8), re-post-trained only. Not to be confused with DeepSeek V4 Pro (ranked, 80.6%) or the plain DeepSeek V4 (77.4%). See /p/deepseek-v4-flash-claims-82-7-terminal-bench/.

Full reviewsClaude Opus 5, decodedDeepSeek V4 Flash, decoded

Ranked on our AI Coding Leaderboard, updated 2026-08-06. Scores are confirmed against primary sources; prices are per 1M input tokens and can change.

Primary sources
  • Anthropicvals.ai — SWE-bench Verified (independent) — Independent (vals.ai, observed Jul 25 2026, mini-swe-agent bash-only harness): SWE-bench Verified 97.00% ±0.76, the highest score on the board and 1st of the 75 systems vals.ai has run. Entered ranked Jul 25, 2026 after one day unranked: Anthropic published no SWE-bench Verified number at launch and still has not, so this is vals.ai's own measurement rather than a vendor claim. Read the #1 as a three-way tie, not a win — GPT-5.6 Sol is at 96.20% ±0.86 (a 0.8-point gap, ~0.7 sigma) and Claude Fable 5 at 95.00% ±0.98 (2.0 points, ~1.6 sigma), both inside the combined margin of error. We rank Opus 5 first only because it scored highest. Where the top two genuinely separate is task length, and not in Opus 5's favour: on the 1-to-4-hour tier Sol solves 98% against Opus 5's 90%, while Opus 5 leads on shorter work (98% under 15 minutes and 97% on 15-minute-to-1-hour tasks, vs 97% and 95% for Sol). Released Jul 24, 2026 at $5/$25 per 1M, the same price as Opus 4.8 and half of Fable 5. Anthropic's launch claims stay unreproducible (Frontier-Bench v0.1, CursorBench 3.2 and Zapier AutomationBench are proprietary), so this is the first externally checkable score the model has. Fast mode runs about 2.5x default speed at 2x base price.
  • DeepSeekvals.ai — SWE-bench Verified (independent) — Independent (vals.ai, Aug 5 2026, mini-swe-agent bash-only harness): SWE-bench Verified 88.8%, for the DeepSeek-V4-Flash-0731 build, matching the checkpoint DeepSeek own change log describes. Ranks above Claude Opus 4.8 (88.6%) and below GPT-5.6 Luna (93.0%). Vendor-reported agent numbers for the same build (DeepSeek change log, Jul 31 2026): Terminal-Bench 2.1 82.7, Cybergym 76.7, Toolathlon verified 70.3, DeepSWE 54.4, NL2Repo 54.2, Agent Last Exam 25.2, produced with DeepSeek own unreleased "DeepSeek Harness minimal mode" and not independently reproduced. The V4-Flash-Preview model card (pre-0731 weights) separately listed SWE-bench Verified 79.0 and Terminal-Bench 2.0 56.9; those are not carried over. Same architecture and size as the preview (284B total / 13B active, FP4+FP8), re-post-trained only. Not to be confused with DeepSeek V4 Pro (ranked, 80.6%) or the plain DeepSeek V4 (77.4%). See /p/deepseek-v4-flash-claims-82-7-terminal-bench/.
  • BenchmarkSWE-bench — the real-GitHub-issue benchmark