Claude Fable 5 vs Kimi K3

head-to-head

what do the benchmarks actually say?

On SWE-bench Verified — real, human-validated GitHub issues resolved end-to-end — Claude Fable 5 posts 95.0% against 93.4% for Kimi K3, a 1.6-point gap. Verified is the closest public proxy for "can it fix a real bug in a real repo without help", which is why it anchors our ranking.

A few points either way is real but not decisive: within that band, the agent scaffolding around the model — how it retrieves files, runs tests, and retries — often matters as much as the base model. Treat the gap as a lean, not a verdict.

which is cheaper to run?

Kimi K3 is the cheaper model: $3 per 1M input tokens ($15 output) versus $10 ($50 output) for Claude Fable 5 — roughly 3.3× less on input. Coding workloads are output-heavy — agents write diffs, tests and retries — so weight the output rate more than the input rate when you estimate a monthly bill.

Kimi K3 ships open weights. Beyond the per-token discount, that means you can self-host it, fine-tune it, pin a snapshot so the model can't change under you, and keep code on your own infrastructure — none of which is possible with Claude Fable 5, which is API-only. For teams with compliance constraints that difference outweighs any benchmark point.

when to pick each

how were these scores verified?

We only print a number once it's confirmed against a primary source or an independent evaluation, and each row on our leaderboard records which kind it is:

• Claude Fable 5: Independent (vals.ai, Jul 14 2026, mini-swe-agent bash-only harness): SWE-bench Verified 95.00% ±0.98. Held the top score until GPT-5.6 Sol was evaluated at 96.20% ±0.86 on the same harness — a 1.2-point gap that is inside the combined margin of error (~0.9 sigma), so the two are a statistical tie and we rank Sol first only because it scored higher. SWE-bench Pro 80.3% uses Anthropic's own scaffolding and is contested. Restored Jul 1, 2026 after a 20-day export-control suspension. Pricing $10/$50 per 1M.
• Kimi K3: Independent (vals.ai, mini-swe-agent bash-only harness): SWE-bench Verified 93.40% ±1.11. Verified Jul 18, 2026 — vals.ai had not run K3 at our Jul 17 check and now ranks it third overall (above GPT-5.6 Luna at 93.0% and Claude Opus 4.8 at 88.6%), making it the highest-scoring open-weight coder we track. Moonshot published no SWE-bench Verified score of its own, only Terminal-Bench 2.1 88.3% on its KimiCode harness, so we rank on the independent number per our standing rule. Also 3rd on Artificial Analysis GDPval-AA v2 and 2nd on AA-Briefcase. Price: Moonshot API $3/$15 per 1M (cache-hit input $0.30); open weights promised Jul 27, 2026.

Full reviewsClaude Fable 5, decodedKimi K3, decoded

Ranked on our AI Coding Leaderboard, updated 2026-07-18. Scores are confirmed against primary sources; prices are per 1M input tokens and can change.