AIAny
Icon for item

Continual Learning Mechanisms Compose for Long-Horizon Memorization

Investigates long-horizon memorization in language models by evaluating how complementary continual-learning mechanisms (data, function, weight anchors and low-rank allocation/LoRA) compose to reduce catastrophic forgetting across 100 sequential tasks; best composition raises final retention from 1.2% to 34.9%.

Introduction

Most continual-learning studies target short sequences of tasks; this paper asks whether composing mechanisms that protect data, function, and weights can scale memorization to much longer horizons. The core insight is that different forgetting modes are complementary and that combining anchors with low-rank allocation (LoRA) yields far larger retention gains than any single method.

Key Findings
  • Composition matters: combining data anchor (generative replay), function anchor (self-distillation), weight anchor (synaptic-style regularization) and merged LoRA produces the strongest retention across datasets.
  • Large numeric gains: naive sequential fine-tuning yields ~1.2% final retention; the best compositional method raises this to 34.9% (≈28× improvement). The best individual mechanism reaches only ~8.1%.
  • Synergy: data anchor and merged LoRA provide the largest average gains and interact super-additively across all three testbeds.
  • Extended memory half-life: task accuracy half-life increases from ~1–2 tasks under naive fine-tuning to roughly 19–44 tasks under top compositions, showing multi-order-of-magnitude shifts in forgetting timescales.
  • Robustness tests: evaluated on three 100-task memorization datasets (Symbol-QA, LLM-QA, Real-QA) and selected configurations via task-level successive halving to manage the large experimental space.
Who it's for and tradeoffs

Great fit if you study continual learning, memory for LMs, or deployment scenarios where models receive many sequential updates without storing past data. The work shows practical mechanism combinations rather than a single silver bullet. Look elsewhere if you need a turnkey production system—compositional methods increase complexity (more losses, tuning, and LoRA management) and do not fully eliminate forgetting.

Methods snapshot

The paper organizes designs along two axes: (1) anchors that specify what the update should preserve (data replay, self-distillation on current inputs, and weight regularizers) and (2) low-rank allocation rules that determine where updates are stored (LoRA variants, merged LoRA). Experiments use task-level successive halving to search ~90 configurations across three distinct 100-task datasets, measuring final retention and temporal accuracy matrices to quantify forgetting.

Information

  • Websitearxiv.org
  • AuthorsZheyuan Zhang, Alvin Zhang, Daniel Khashabi, Tianmin Shu
  • Published date2026/09/07

More Items

Defines recursive self-improvement (RSI) with an evaluation metric (Headroom-Closed Index) and a five-level autonomy roadmap—from executing human-specified improvements to recursively improving improvement mechanisms—while analyzing scenarios, verification challenges, and governance risks.

Presents an open 7B dense foundation model for mathematical reasoning and tool-assisted web search, supporting 256K-token context. Key features: hybrid gated sliding-window + global attention for efficient long-context training, FP8 Muon optimizer, progressive 16K→64K→256K curriculum, and open-source weights, data, and recipes.

Presents Atria Dawn Preview, an agentic foundation LLM trained with a Verifiable Experience Pipeline to connect tool-mediated interactions to executable environments; evaluated across 16 real-world research and engineering benchmarks with top scores on five, and a human–AI collaboration analysis of 769 task records.