AIAny
Icon for item

Metis: Memory Foundation Model

Presents Metis, a prototype memory foundation model that embeds a persistent native memory state into the backbone so historical experience is compressed and accessed via memory attention. Key features: forward-only, gradient-free online memory updates; memory-specific mid-training objectives; and a dual text/code memory design.

Introduction

Why this matters

Large AI agents increasingly rely on external memory modules or separate tool libraries, which creates inefficiencies in latency, optimization and end-to-end learning. Metis asks a simple but consequential question: what if a foundation model itself held a persistent, dynamically evolving memory state and native procedures to read/write that state? The paper argues that native memory can streamline inference, enable new optimization objectives during mid-training, and let memory updates happen via ordinary forward passes while model weights remain frozen.

Key Findings
  • Native memory architecture: Metis extends a foundation model with an internal memory state accessible through memory attention. So what? Historical signals can be compacted into the model and retrieved with lower orchestration cost than external modules.

  • Gradient-free online updates: Memory maintenance at runtime is implemented without backprop — updates require only a forward pass over the model. So what? This decouples memory dynamics from weight updates and enables efficient persistent state changes at inference time.

  • Memory-tailored training and dual representation: The authors construct large-scale memory-specific mid-training corpora and optimization objectives to teach read/write procedures. Metis also uses a dual memory representation (textual experiences + callable code tools) to balance generality and executable patterns.

Who it fits and tradeoffs

Great fit if you research model-centric stateful agents, want to explore end-to-end memory procedures inside model backbones, or need lower-latency persistent state for long-horizon interactive tasks. Look elsewhere if you require off-the-shelf, auditable external databases for memory provenance, or if your deployment strictly forbids persistent in-memory state inside model processes (e.g., transient-only stateless inference). Metis prioritizes architectural and training-level exploration rather than turnkey production tooling.

Method sketch

Metis learns native memory via mid-training objectives that supervise both storage and retrieval behaviors; at runtime, selected memories influence generation through memory attention while weights are frozen and memory states evolve through standard forward computation. The design is evaluated on agentic benchmarks and analyzed for capabilities and limitations.

Information

  • Websitearxiv.org
  • AuthorsZeyu Zhang, Ziliang Guo, Yihang Sun, Xichong Zhang, Xixuan Hao, Zehao Lin, Yang Zhang, Xiaoyan Zhao, Tong Shen, Bo Tang
  • Published date2026/07/29

More Items

Converts text prompts into physically consistent videos by synthesizing executable Blender programs as a process-level chain-of-thought and using a dual-engine pipeline (deterministic simulation draft + draft-conditioned video editor). Ships with a VideoCoCo-3K draft–instruction–target dataset and shows substantial gains in physical-consistency benchmarks.

Evaluates whether vision-language models can make actionable decisions for a physical body by decoupling decision-making from low-level motor execution. Introduces HumanCLAW-Bench with 1,218 long-horizon egocentric episodes across 41 indoor scenes and diagnoses a lack of embodied self-awareness in current VLMs.

Measures how agent memory systems miss implicitly associated facts by introducing InMind, a 125-task benchmark with paired controls that separate stored-vs-retrieval vs knowledge gaps. Quantifies a large retrieval-interface blind spot and points to routing as the core open problem.