Claude Opus 5 vs Gemini 3.7 Flash

head-to-head

what do the benchmarks actually say?

On SWE-bench Verified — real, human-validated GitHub issues resolved end-to-end — Claude Opus 5 posts 97.0% against 80.8% for Gemini 3.7 Flash, a 16.2-point gap. Verified is the closest public proxy for "can it fix a real bug in a real repo without help", which is why it anchors our ranking.

A few points either way is real but not decisive: within that band, the agent scaffolding around the model — how it retrieves files, runs tests, and retries — often matters as much as the base model. Treat the gap as a lean, not a verdict.

which is cheaper to run?

Gemini 3.7 Flash is the cheaper model: $0.75 per 1M input tokens ($3.75 output) versus $5 ($25 output) for Claude Opus 5 — roughly 6.7× less on input. Coding workloads are output-heavy — agents write diffs, tests and retries — so weight the output rate more than the input rate when you estimate a monthly bill.

when to pick each

how were these scores verified?

We only print a number once it's confirmed against a primary source or an independent evaluation, and each row on our leaderboard records which kind it is:

• Claude Opus 5: Independent (vals.ai, observed Jul 25 2026, mini-swe-agent bash-only harness): SWE-bench Verified 97.00% ±0.76, the highest score on the board and 1st of the 75 systems vals.ai has run. Entered ranked Jul 25, 2026 after one day unranked: Anthropic published no SWE-bench Verified number at launch and still has not, so this is vals.ai's own measurement rather than a vendor claim. Read the #1 as a three-way tie, not a win — GPT-5.6 Sol is at 96.20% ±0.86 (a 0.8-point gap, ~0.7 sigma) and Claude Fable 5 at 95.00% ±0.98 (2.0 points, ~1.6 sigma), both inside the combined margin of error. We rank Opus 5 first only because it scored highest. Where the top two genuinely separate is task length, and not in Opus 5's favour: on the 1-to-4-hour tier Sol solves 98% against Opus 5's 90%, while Opus 5 leads on shorter work (98% under 15 minutes and 97% on 15-minute-to-1-hour tasks, vs 97% and 95% for Sol). Released Jul 24, 2026 at $5/$25 per 1M, the same price as Opus 4.8 and half of Fable 5. Anthropic's launch claims stay unreproducible (Frontier-Bench v0.1, CursorBench 3.2 and Zapier AutomationBench are proprietary), so this is the first externally checkable score the model has. Fast mode runs about 2.5x default speed at 2x base price.
• Gemini 3.7 Flash: Independent (vals.ai, mini-swe-agent bash-only harness): SWE-bench Verified 80.80% ±1.76. Released Aug 13, 2026, three weeks after Gemini 3.6 Flash. Google published NO SWE-bench Verified score of its own, exactly as with 3.6 Flash, so this rank rests entirely on the independent run. Its launch claims are all vendor-reported on Google scaffolding: DeepSWE v1.1 65.3% (up from 49.0%), FrontierCode 1.1 Main 43.6% (up from 34.4%), WebDev Arena Elo 1588 (up from 1538), GDP.pdf 34.0% (up from 22.0%), AutomationBench 30.4% (up from 17.0%). Read those with the 3.6 Flash precedent in mind: Google claimed a 12-point DeepSWE jump for that model too, and vals.ai then measured it at 79.60% ±1.80 against 78.8% for 3.5 Flash, a statistical tie. Price: introductory $0.75/$3.75 per 1M through Dec 31, 2026, reverting to $1.50/$7.50 on Jan 1, 2027, i.e. back to 3.6 Flash list. Specs: 1,048,576 input / 65,536 output tokens; thinking levels low/medium/high only (minimal now errors); computer use still preview. See /p/gemini-3-7-flash-half-price-3-5-pro-missing/. **Ranked 2026-08-17**: vals.ai evaluated it and we now rank on that independent figure, since Google still publishes no SWE-bench Verified score of its own. It entered our verifying queue on Aug 13 and left it four days later. Worth recording that the 3.6 Flash precedent did NOT repeat: that model turned a claimed 12-point DeepSWE jump into a statistical tie, whereas 3.7 Flash gains a real 1.2 points over 3.6 Flash (79.60%) on the same harness. The gain is still inside the combined margin of error, so read 3.7 Flash, 3.6 Flash and Claude Sonnet 5 as a three-way tie rather than a ranking.

Full reviewsClaude Opus 5, decodedGemini 3.7 Flash, decoded

Ranked on our AI Coding Leaderboard, updated 2026-08-17. Scores are confirmed against primary sources; prices are per 1M input tokens and can change.