Verification register AI & Agents
Living definition
What is SWE-bench Pro?
AI Coding & Software Agents AI & Agents
- As of
- 2026-06-28
- Revision
- 2026-07-19.1
- Method
- v1.2.0
Definition
The term, in context
AI-assisted draft · approved dataset
SWE-bench Pro is a benchmark that measures how well an AI coding agent resolves real, held-out software-engineering issues drawn from open-source repositories.
Live readiness status
Status as of the current dateline
AI-assisted assembly · derived results
As of 2026-06-28, verified readiness is 61 (claimed 78, reported 70, gap 17) — Strong evidence strength; current signals suggest Adopt with guardrails.
The readiness fact belongs to the canonical Readiness Verdict for SWE-bench Pro.
Dataset approval
Human editorial release
pragma.vision editorial — standing authorization (operator dev@soft.house, 2026-07-17)
- Dataset
- 2026-07-19.1
- Hash
- sha256:879aa251cd33f19a4cd70ef7db5753df0822d65408e7a15065212c6b421fd9d4
- Approved
- 2026-07-19