AIAny
Icon for item

The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement

Defines recursive self-improvement (RSI) with an evaluation metric (Headroom-Closed Index) and a five-level autonomy roadmap—from executing human-specified improvements to recursively improving improvement mechanisms—while analyzing scenarios, verification challenges, and governance risks.

Introduction

Why this matters

Current AI workflows scale model size and automation but still rely on humans for designing what to change, how to evaluate changes, and which improvements to keep. The paper's core insight is to treat self-improvement as an engineering object: close the improvement loop, require persistent inheritance of changes, and measure how much of the improvement pipeline an AI actually internalizes. This turns the vague slogan “AI improves itself” into a testable sequence of capabilities and failure modes.

Key Findings
  • Headroom-Closed Index (HCI): a diagnostic metric that compares observed performance progress against an estimated observable upper bound across capability domains, highlighting where single-shot model gains are insufficient and where iterative, experience-driven RSI could matter.
  • Five-level autonomy taxonomy: a practical roadmap from B0 (task-level retries) through L1 (execution autonomy), L2 (strategy autonomy), L3 (experience-acquisition autonomy), L4 (deployment/environment adaptation), to L5 (recursive/meta improvement) — each level specifies what responsibilities the AI internalizes and what persistence of change is required.
  • Scenario analysis: software engineering is identified as an early experiment bed (rich logs, tests, rollbacks); embodied agents provide real-world feedback but face safety and cost constraints; scientific RSI requires strong experiment provenance and costly validation; medical RSI needs strict governance and traceability.
  • Evaluation and risk emphasis: the paper stresses proving inheritance of changes (cross-round trends, rollbacks, independent transfer tasks) and warns RSI can persistently embed bugs, reward hacks, or poisoned memories, so verification, rollback, and provenance are core system requirements.
Who this is for and trade-offs

Great fit if you work on: AI agents, AutoML/AI4AI pipelines, automated software engineering, or research automation; the taxonomy helps design experiments that move beyond one-off reflection to persistent change. Look elsewhere if you only need single-task, ephemeral self-correction (the paper separates B0-style retries from genuine RSI).

Trade-offs: pursuing higher RSI levels increases autonomy but also raises verification, safety, and governance burdens. Early-stage RSI work is most tractable in domains with verifiable tests and rich telemetry (software engineering), while domains with high-cost, delayed, or unsafe feedback (clinical care, physical robotics) require conservative, human-in-the-loop deployment and strong rollback mechanisms.

Where it fits

Use this framework to benchmark whether an agent is merely “agentic” (planning and tool use within a task) or truly self-improving across deployments. The HCI helps prioritize capability domains where iterative improvement pipelines could yield real-world impact rather than marginal benchmark gains.

Practical takeaway

If you plan to build AI systems that modify their own training/data/evaluation processes, design experiments that (1) persist state between rounds, (2) include independent transfer/rollback controls, and (3) measure whether changes improve not just immediate outputs but the quality of subsequent improvement cycles.

Information

  • Websitearxiv.org
  • OrganizationsShanghai Jiao Tong University, Theseus Labs, Tsinghua University, ByteDance, Mianbi Intelligent, Xiaohongshu, Shanghai Artificial Intelligence Laboratory
  • AuthorsYi Duan, Ying Liu, Zirui Tang, Haodong Chen, Jun Zhou, Yumou Liu, Bangrui Xu, Yukai Wu, Sidi Chen, Yuhan Zhou
  • Published date2026/09/10

More Items

Investigates long-horizon memorization in language models by evaluating how complementary continual-learning mechanisms (data, function, weight anchors and low-rank allocation/LoRA) compose to reduce catastrophic forgetting across 100 sequential tasks; best composition raises final retention from 1.2% to 34.9%.

Presents an open 7B dense foundation model for mathematical reasoning and tool-assisted web search, supporting 256K-token context. Key features: hybrid gated sliding-window + global attention for efficient long-context training, FP8 Muon optimizer, progressive 16K→64K→256K curriculum, and open-source weights, data, and recipes.

Turns past discovery traces into replayable simulators so alternative exploration policies can be evaluated offline ('dreaming'), enabling fast, low-cost meta-level policy improvement for agent-driven discovery across coding, optimization, and GPU-kernel tasks.