Evaluates vision-language model judges on computer-using agent (CUA) trajectories to measure verifier reliability. Provides OSReward-Hard and OSReward-Multi challenge sets, the OS-Shepherd-100K reasoning-annotated corpus, and trained OS-Shepherd reward models that match commercial judges at ~30–60× lower cost.
A 365-day, order-level simulation benchmark for evaluating long-term coherence of LLM agents in seller-side e-commerce. Grounded in 98,843 real product records and 26 interactive tools, it pairs prompt upstream supplier signals with delayed downstream order outcomes to stress planning, memory, and tool use over long horizons.
Treats agent self-improvement as natural selection over a population of harnesses (prompts, tools, skills, control flow), evolving a frozen-model agent by selecting harness edits that extend capability without regressing others. Uses a preserve-and-extend contract, lineage archive, and verifier-driven fitness (no gold solutions) to recombine complementary edits and transfer across benchmarks.
Evolves persistent, stateful environments to red-team tool-using AI agents — provides 10K+ validated scenarios across 50 domains and a feedback-driven attack policy (EMHA) to surface long‑horizon safety failures.
Frames skill generation as a sequential editing task and introduces a novel rollback reward to train an RL generator (Skill-α) that evaluates each edit by its downstream execution impact, producing skills that improve agent success rates across document-to-skill and experience-to-skill settings.
Reformulates long-horizon agent execution as explicit task-state management: a manager defines bounded subtasks, fresh-context executors run them, and read-only auditors verify outcomes. Shows large performance gains on WeaveBench, Terminal-Bench and OSWorld.
Analyzes how to build effective training environment distributions for multimodal agents and proposes Ability-aware Environment Selection (AES) and Hierarchical Difficulty Curriculum (HDC) to improve diversity and difficulty scheduling, yielding large relative gains in experiments.
Turns open-ended everyday requests into a managed long-horizon execution process that decomposes tasks into bounded subtasks, maintains compact execution memory under context pressure, and verifies and repairs final deliverables. Designed to run unchanged across multiple LLM backends and evaluated on AgentIF-OneDay.
Generates large-scale, explorable 3D open-world scenes from open-ended text prompts, producing editable instance-level assets and a consistent global terrain. Uses agentic planning to convert text into region/terrain/asset specifications and a coarse-to-fine pipeline for terrain construction, mesh reconstruction, and render-based refinement.
Orchestrates reasoning, external tool use, and native image generation under one unified multimodal agent policy via post-training. Introduces RAD-GRPO for agentic reinforcement fine-tuning and releases training data plus the full post-training infrastructure.
Replaces external environment interaction in agentic RL training with 'world rehearsal': the policy alternates between making tool calls and simulating their environment responses, jointly optimizing both roles so the agent internalizes environment dynamics and improves long-horizon tool use and transfer.
Converts sparse trajectory-level rewards into turn-level credit by aggregating token-level teacher–student log-probability gaps and recursively updating a Bayesian belief in log-odds; produces turn-wise reweighting for policy optimization without an extra critic or rollouts.