AIAny
Icon for item

ABot-N1: Toward a General Visual Language Navigation Foundation Model

Unifies high-level visual-language reasoning and low-level control for visual navigation by decoupling cognition and control: a slow vision-language reasoner produces pixel goals with explicit chain-of-thought, and a fast action expert converts those anchors into continuous waypoints for robust urban and indoor navigation.

Introduction

Urban-scale and embodied navigation still fail in the wild because end-to-end policies conflate long-horizon reasoning with high-frequency control, causing coordinate drift, brittle long-tail semantics handling, and poor interpretability. The core insight of ABot-N1 is that splitting cognition and control — using explicit V-L reasoning to emit compact, pixel-grounded goals, then feeding those anchors to a high-frequency action expert — yields a navigation foundation that is simultaneously more general, robust, and interpretable.

Key Findings
  • Decoupled slow–fast architecture: a slow vision-language reasoner performs explicit Chain-of-Thought and produces pixel-space anchor goals; a fast action expert uses textual cues plus those pixel anchors to output continuous waypoints. This separation reduces drift and preserves high-rate control.
  • Broad task coverage with a single interface: the pixel-anchor interface supports point-goal, object-goal, POI-goal, instruction-following, and person-following without task-specific policy changes—so the same model family generalizes across embodied navigation tasks.
  • Strong empirical gains at scale: ABot-N1 sets new state-of-the-art marks in urban-scale navigation, increasing POI arrival by 35.0% (to 77.3%) and achieving 95.4% / 92.9% success rates in complex indoor and outdoor scenes, demonstrating robustness across diverse benchmarks.
  • Interpretability and diagnostics: pixel-grounded anchors paired with linguistic traces provide human-readable reasoning steps and compact failure modes for easier debugging compared with black-box action policies.
Who it's for and tradeoffs

Great fit if you need a single navigation backbone that generalizes across indoor/outdoor and multiple goal modalities, and you value interpretability and robustness in long-horizon urban scenes. Look elsewhere if your deployment strictly requires minimal latency on devices that cannot afford a slower reasoning loop, or if you need a purely end-to-end learned policy without explicit intermediate representations.

Where it fits

ABot-N1 positions itself between monolithic end-to-end navigation policies (which map observations directly to actions) and heavyweight modular stacks (separate SLAM + planning + perception). It provides an interpretable, compact interface (pixel anchors) that keeps planning lightweight while enabling V-L reasoning to handle semantic complexity and long-range instructions.

How it works (high level)

The slow V-L reasoner ingests visual observations and textual cues, executes explicit multi-step reasoning (Chain-of-Thought) to identify image-space anchor points as subgoals, and emits linguistic traces describing intent. The fast action expert runs at control frequency, fusing pixel anchors and language hints to generate continuous waypoints and control commands. New Point-Goal/POI-Goal benchmarks are released open source to evaluate urban-scale performance and accelerate comparison.

Information

  • Websitearxiv.org
  • AuthorsRuiyan Gong, Yingnan Guo, Junjun Hu, Jintao Kong, Xiaoxu Leng, Tianlun Li, Weize Li, Fei Liu, Zhicheng Liu, Jia Lu
  • Published date2026/07/11

More Items

Continuously records egocentric visual and audio streams into a lightweight streaming memory that organizes experiences into current, short-term, and long-term tiers and retrieves multimodal evidence to answer queries about past events. Built for on-device use (smartphones/AI glasses) with dynamic retrieval routing.

Reconstructs 4D dynamic human scenes from sparse, low-overlap multi-camera captures by decoupling background synthesis and human modeling. Synthesizes hundreds of camera-controlled background views with a video diffusion model, initializes deformable Gaussian humans via cross-view identity and triangulated keypoints, then applies motion-adaptive recursive enhancement to reduce artifacts.

Provides a deliberative Agent OS layer for robots that handles scene-conditioned planning, context-isolated skill execution, multi-stage verification, persistent multi-modal graph memory, and edge–cloud collaboration. Introduces EmbodiedWorldBench (16 scenes, 200+ tasks) and a failure-driven self-evolution loop; shows improved task success and strong memory benchmark scores.