Benchmark for evaluating agents' ability to deliver working AI systems in realistic customer environments: 95 end-to-end delivery tasks with scripted stakeholders and production-like systems, scored by improvement to the customer's business metric and penalized for stakeholder contact.
Trains an agent orchestrator through recursive self-play, then withdraws skills once they stop improving performance. Learnability-driven task selection and controlled skill evaluations aim to move the system toward deployment without external skills.
Provides a training-free multimodal reasoning harness that combines heterogeneous visual tools, persistent multimodal memory, and code execution so MLLMs can iteratively acquire and compose grounded evidence. Improves accuracy on 22 benchmarks by about 9.7–12.6 points while cutting comparative token costs.