Converts real repositories into verifiable, sandboxed training environments with black-box tests to train coding agents on long-horizon program reproduction. Provides Program-Env for automated environment construction and Program-Agent for a role-isolated development workflow, yielding 1,648 C/C++/Go/Rust tasks and improving benchmark performance.
Measures whether coding agents can build agents that truly satisfy natural-language requirements via AgentSWE: a 25-task benchmark spanning Creation, Editing, and Optimization. Builders develop against few illustrative cases; acceptance runs frozen submissions on held-out cases and requirement-derived rubrics, exposing overfitting, hollow runtimes, and unsupported completion claims.