AI Agent Papers2026
Benchmark for evaluating agents' ability to deliver working AI systems in realistic customer environments: 95 end-to-end delivery tasks with scripted stakeholders and production-like systems, scored by improvement to the customer's business metric and penalized for stakeholder contact.
Answers spatial choice, scalar, and point questions by classifying among discretized candidates using pretrained attention projections from a Qwen3.5-4B backbone instead of autoregressive text generation. Trains on converted spatial QA data, adopts coarse-to-fine refinement and joint multi-stage supervision, and reports higher accuracy with several-fold faster inference than autoregressive baselines.