AIAny
Icon for item

ASPIRE: Agentic /Skills Discovery for Robotics

Autonomously generates, iteratively debugs, and composes robot control programs into a reusable skill library for discovering and refining manipulation skills across simulation and real robots. Uses a code-as-policy continual learning loop—accumulating validated sensorimotor skills instead of model weights—to tackle long-horizon household and benchmark tasks.

Introduction

Most robot control pipelines rely on hand-crafted modules or end-to-end learned policies that are brittle under distribution shift. ASPIRE takes a different perspective: treat program text as the policy, use coding agents to propose and iteratively debug control programs, and distill validated fixes into a growing library of reusable skills. This lets the system compund experience across tasks, embodiments, and sim/real settings rather than retraining monolithic weights for each new scenario.

What Sets It Apart
  • Code-as-policy continual learning: agents write executable Python control programs, run them in a closed-loop execution engine that exposes multimodal traces (perception overlays, trajectories, collisions), diagnose failures, and synthesize repairs. So what: faults are fixed at the program level and distilled into modular skills rather than buried in opaque weights.
  • Skill library that compounds experience: discovered fixes become reusable primitives that accelerate zero-shot generalization and transfer between tasks, simulators, and different robot embodiments. So what: library growth yields faster adaptation and stronger zero-shot performance on unseen long-horizon tasks.
  • Evolutionary, multi-agent search plus closed-loop verification: an evolutionary search generates diverse candidate programs while iterative debugging validates outcomes and extracts robust repairs. So what: exploration goes beyond single-trajectory refinement, improving robustness under perturbations and long-horizon failure modes.
  • Demonstrated scale and sim-to-real: achieves near-saturation on standard benchmarks with strong LLMs (e.g., 99% success on 80 LIBERO-Pro tasks with Claude Opus 5.5), provides sim-to-real skill transfer and online real-robot learning (including a Rubik’s Cube demo). So what: empirical evidence that coding-agent-driven skill discovery can reach high success rates on complex manipulation benchmarks and reduce real-robot programming effort.
Who It's For and Trade-offs

Great fit if you need a research-grade platform to explore agentic program synthesis for robotics, want modular reusable manipulation skills, or are reproducing long-horizon household and benchmark experiments (LIBERO-Pro, Robosuite, BEHAVIOR-1K). It is also suited for teams that can run closed-loop simulation and accept generated code execution under strict isolation.

Look elsewhere if you require turnkey industrial deployment without manual oversight: the system runs language-model-generated Python (security risks), real-robot runs require operator controls and careful sandboxing, and reproducing top results depends on access to high-capability coding agents and compute. ASPIRE focuses on autonomous skill discovery and research reproducibility rather than packaged production integration.

Information

  • Websitegithub.com
  • OrganizationsNVIDIA, University of Michigan, University of Illinois Urbana-Champaign, UC Berkeley, Carnegie Mellon University
  • AuthorsRunyu Lu, Yubo Wu, Ethan Kou, Haotian Lin, Letian Fu, Wenli Xiao, Ajay Mandlekar, Yinzhen Xu, Guanya Shi, Ken Goldberg …
  • Published date2026/07/08

More Items

Turns a VLM into a robot-coding agent that directly drives a dual-arm robot from three RGB cameras, iteratively writing and fixing small executable perception and control tools from observations and logs; evaluated on 42 RoboDojo tasks.

Evaluates GPT-6-Astra as an embodied policy across 12 robotic benchmarks, examining in‑context learning, hybrid System‑2/System‑1 control, and real‑world deployment gaps; finds strong benchmark competence but practical limits from demonstration cost, latency, and failure recovery.

GitHub
AI Agent2025

Provides a Python and TypeScript SDK to build and run production AI agent harnesses — the agent loop plus tools, memory, sessions, context management and lifecycle controls — with model portability and built-in observability.