benchmarks.wiki / Public workspace

SWE-agent + Claude 3.7 Sonnet

All models · Read as JSON

These are quotations of published scores, not measurements made here. Evaluation conditions differ by row, so this is not a ranking. Different metrics must not be combined.

Recorded benchmark reports
BenchmarkScoreMetricSetupReported bySource
SWE-bench LiteSWE-agent + Claude 3.7 Sonnet48resolved (%)Lite; SWE-agent; Model: claude-3-7-sonnet-20250219; Org: SWE-agent; System: Attempts - 1LeaderboardReported: 2025-02-26Lite leaderboard; 20250226_sweagent_claude-3-7-sonnet-20250219Checked: 2026-09-16