AIAny
Icon for item

Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnesses

Proposes Recuris, a recursive Experiential-Working Memory architecture that separates Working Memory (task progress) from Experiential Memory (skills) and uses a Meta-Agent to validation-gate localized skill updates, enabling bounded recursive skill evolution for long-horizon agents.

Introduction

Long-horizon interactions accumulate noisy histories that obscure task state and misalign skill use; Recuris flips the problem by keeping a compact Working Memory to guide skill selection from an evidence-backed Experiential Memory and using localized, validation-gated updates to evolve skills over time.

Key Findings
  • Structured coupling of Working Memory and Experiential Memory localizes execution failures to specific memory components, making updates more targeted and reliable.
  • A fixed Meta-Agent converts execution evidence into gated updates to Skill Memory, producing a bounded recursive loop that reshapes future execution.
  • Broad empirical gains: improved success in 35 of 37 model–benchmark pairs; +17.8 points on GPT-5.6 Sol and +15.6 on Claude Opus 5 (taking Opus 5 to 87.9%); +16.6/+13.5 on Qwen3.6-27B/35B on SkillFlow; up to +32.2 points on the longest tasks and up to 80% reduction in common long-horizon failures.
  • Code and artifacts released for reproducibility and follow-up experimentation.
Who it's for and trade-offs

Great fit if you build or evaluate LLM-driven agents on long-horizon tasks and need a systematic way to convert episodic experience into reusable, validated skills. The approach scales with interaction horizon and is model-agnostic across modern LLM backbones. Look elsewhere if your tasks are strictly single-step or if your primary constraint is removing all external orchestration (Recuris assumes an external harness and a Meta-Agent for policy updates).

Information

  • Websitearxiv.org
  • OrganizationsNUS, Princeton University, Stanford University, University of Oxford
  • AuthorsZhaochen Yu, Yingcheng Wu, Zhenfei Yin, Kaiyuan Chen, Zhe Zhao, Mengdi Wang, Shuicheng Yan, Ling Yang
  • Published date2026/08/25

More Items

Uses large-scale, mixed-task reinforcement learning to drive self-improvement of multimodal foundation models. Key features include fully-asynchronous large-batch RL (1,568 prompts × 16 rollouts, up to 3.7B tokens/update, 1M context), groupwise agentic grading, and sparse MoE architectures.

Lets a pretrained multimodal LLM interpret navigation requests and orchestrate motion via tool calls for generalist robot navigation across unfamiliar scenes. Key features: an agent harness with Navigation Skills, a unified visual-point interface, task-progress tracking, and tool-based motion execution without navigation-specific fine-tuning.

Creates programmable, real-time interactive code-based environments by separating deterministic simulator state from a shared neural video renderer so agents perceive, interact, and iteratively evolve via distilled playbooks; introduces Adversarial Forcing to distill a geometry-conditioned renderer for responsive visual feedback.