benchmarks.wiki / Public workspace

SWE-agent + Claude 4 Sonnet

All models · Read as JSON

These are quotations of published scores, not measurements made here. Evaluation conditions differ by row, so this is not a ranking. Different metrics must not be combined.

Recorded benchmark reports
BenchmarkScoreMetricSetupReported bySource
SWE-bench LiteSWE-agent + Claude 4 Sonnet56.67resolved (%)Lite; SWE-agent; Model: claude-4-sonnet-20250514; Org: SWE-agent; System: Attempts - 1LeaderboardReported: 2025-05-26Lite leaderboard; 20250526_sweagent_claude-4-sonnet-20250514Checked: 2026-09-16