A PyTorch-native training framework for agentic reinforcement learning research that keeps researcher-facing code compact and editable. Uses an asynchronous loop to train multimodal and mixture-of-experts policies while never training on tokens the agent didn't generate; matches Megatron-style stacks under a comparable protocol and ships recipes and containers on GitHub.
Alternates targeted research and constraint-wise audits to recursively improve long-horizon answers: an inner loop gathers evidence and drafts solutions, an outer loop audits unresolved claims and launches focused follow-ups. Trains 4B dense and 122B-A10B MoE agents with long-horizon RL and agentic mid-training, outperforming comparable-scale baselines on multi-step research benchmarks.
Presents Skill Self-Play (Skill-SP), a co-evolutionary training loop where a proposer, solver, and dynamic skill controller generate, solve, and verify tasks conditioned on reusable skills — balancing verifiable execution with open-ended task diversity to boost LLM tool-use and reasoning.
Drives long‑horizon desktop agents by reading and manipulating program state (files, DOM, backends) instead of relying on screenshots. The main agent uses code for actions and structural verification while a lightweight GUI subagent handles rare screenshot-click steps, improving success rates and lowering per-task cost versus screenshot-only approaches.
Lets canvas-native agents plan, generate, edit, and organize long-horizon multimodal creative projects by representing artifacts, versions, and actions as typed canvas nodes and links. Uses a three-layer design (canvas state, protocol bridge, agent runtime) so agents act within an inspectable, editable project state.
Turns document relevance into an execution prior for agentic corpus interaction: orders documents for sequential ripgrep traversal, seeds promising entry points with query-relevant paragraphs, and reranks grep matches to surface informative excerpts. Improves the accuracy–efficiency frontier on browse QA and reasoning-intensive retrieval.
Measures how agent memory systems miss implicitly associated facts by introducing InMind, a 125-task benchmark with paired controls that separate stored-vs-retrieval vs knowledge gaps. Quantifies a large retrieval-interface blind spot and points to routing as the core open problem.
Bridges the proprietary-to-open-source gap in agentic search by converting multi-step retrieval and reasoning traces into a structured, style-normalized JSON protocol and using it for joint distillation + RL. Produces denser supervision that improves student success rates while reducing style drift.
Presents Metis, a prototype memory foundation model that embeds a persistent native memory state into the backbone so historical experience is compressed and accessed via memory attention. Key features: forward-only, gradient-free online memory updates; memory-specific mid-training objectives; and a dual text/code memory design.
Converts text prompts into physically consistent videos by synthesizing executable Blender programs as a process-level chain-of-thought and using a dual-engine pipeline (deterministic simulation draft + draft-conditioned video editor). Ships with a VideoCoCo-3K draft–instruction–target dataset and shows substantial gains in physical-consistency benchmarks.
Evaluates whether vision-language models can make actionable decisions for a physical body by decoupling decision-making from low-level motor execution. Introduces HumanCLAW-Bench with 1,218 long-horizon egocentric episodes across 41 indoor scenes and diagnoses a lack of embodied self-awareness in current VLMs.
Designs and evaluates a foundation GUI agent that performs cross-platform GUI and CLI actions on real devices to complete long-horizon workflows. Emphasizes a unified action space, a large-scale real-device mobile runtime, an AutoResearch-style data flywheel, and online RL training across 10,000+ concurrent environments.