MEASUREMENTS

Top Harness Leaderboard

SWE-bench Verified: submitted agent systems solving real software issues. Scores are percent resolved; each entry retains its agent, model and checked status.

Build snapshot retrieved 2026-10-30T22:39:25.727891+00:00. Live data loads in your browser.

RANKSYSTEM / MODELSCORECONTEXT
01Sonar Foundation Agent + Claude 4.5 Opus ↗79.20SWE-bench Verified · Sonar Foundation Agent · submitted result
2025-12-05
02live-SWE-agent + Claude 4.5 Opus medium (20251101) ↗79.20SWE-bench Verified · live-SWE-agent · submitted result
2025-12-15
03TRAE + Doubao-Seed-Code ↗78.80SWE-bench Verified · TRAE · submitted result
2025-09-28
04live-SWE-agent + Gemini 3 Pro Preview (2025-11-18) ↗77.40SWE-bench Verified · live-SWE-agent · checked run
2025-11-20
05EPAM AI/Run Developer Agent v20250719 + Claude 4 Sonnet ↗76.80SWE-bench Verified · EPAM AI/Run Developer Agent · submitted result
2025-08-04
06Atlassian Rovo Dev (2025-09-02) ↗76.80SWE-bench Verified · Atlassian Rovo Dev · submitted result
2025-09-02
07Claude 4.5 Opus (high) ↗76.80SWE-bench Verified · mini-SWE-agent · submitted result
2026-02-17
08ACoder ↗76.40SWE-bench Verified · ACoder · submitted result
2025-08-19
09Gemini 3 Flash (high) ↗75.80SWE-bench Verified · mini-SWE-agent · submitted result
2026-02-17
10MiniMax M2.5 (high) ↗75.80SWE-bench Verified · mini-SWE-agent · submitted result
2026-02-17
11Warp ↗75.60SWE-bench Verified · Warp · submitted result
2025-09-01
12Claude 4.6 Opus ↗75.60SWE-bench Verified · mini-SWE-agent · submitted result
2026-02-17
13TRAE + Claude Sonnet 4 + Opus 4 + Sonnet 3.7 + Gemini 2.5 Pro ↗75.20SWE-bench Verified · TRAE · submitted result
2025-06-12
14Harness AI ↗74.80SWE-bench Verified · Harness AI · submitted result
2025-07-31
15Sonar Foundation Agent + Claude 4.5 Sonnet ↗74.80SWE-bench Verified · Sonar Foundation Agent · submitted result
2025-11-03
16Lingxi-v1.5_claude-4-sonnet-20250514 ↗74.60SWE-bench Verified · Lingxi-v1.5 · submitted result
2025-07-20
17JoyCode + Claude 4 Sonnet + GPT-4.1 ↗74.60SWE-bench Verified · JoyCode · submitted result
2025-09-15
18Refact.ai Agent + Claude 4 Sonnet + o4-mini ↗74.40SWE-bench Verified · Refact.ai Agent · submitted result
2025-06-03
19Prometheus-v1.2.1 + GPT-5 ↗74.40SWE-bench Verified · Prometheus-v1.2.1 · submitted result
2025-10-15
20Claude 4.5 Opus (20251101) (medium) ↗74.40SWE-bench Verified · mini-SWE-agent · checked run
2025-11-24
Method, limits & original data

SWE-bench Verified: submitted agent systems solving real software issues. Scores are percent resolved; each entry retains its agent, model and checked status.

Rows are ranked within this benchmark. Different hardware, model versions, harnesses and test conditions can change results. A blank or absent score is never treated as zero. Ties retain equal rank in the interactive view.

Additional benchmark references: Arena · Artificial Analysis · Terminal-Bench. Keyed APIs are not exposed in this website.