AIAny
Icon for item

TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM

Directly maps visual observations and language instructions to continuous robot actions, replacing LLM-centric V→L→A pipelines. Uses separate visual and language encoders with lightweight bidirectional interaction and a compact decoder to cut inference cost and VRAM, achieving ~31 ms latency and <1 GB VRAM on an RTX 4090; suited for real-time robotic manipulation under tight compute budgets.

Introduction

Most VLA work routes vision into a large language model, then decodes language into actions — an approach that works but pays a heavy price in per-step compute and GPU memory. TurboVLA challenges that norm by building task-conditioned representations directly from visual and linguistic features and exchanging information via a lightweight bidirectional interaction, enabling continuous action chunk prediction with a compact decoder. The result is VLA-level performance at dramatically lower latency and VRAM use, making real-time robotic manipulation feasible on consumer GPUs.

Key Findings
  • Direct V+L→A mapping: Separates visual and language encoders and uses a lightweight bidirectional interaction module so the policy does not require a large LLM as the central interface. This reduces model size and per-step compute.

  • Strong empirical efficiency: On the LIBERO benchmark TurboVLA reports 97.7% average success using only ~0.2B parameters, with 31.2 ms inference latency (~32 Hz) and ~0.9 GB VRAM on an RTX 4090. These numbers show it can match or exceed much larger LLM-centric VLA policies while running in resource-constrained settings.

  • Practical decoder design: Predicts continuous action chunks with a compact decoder instead of autoregressively decoding through a large language space, improving throughput for sequential decision tasks.

Who It's For and Tradeoffs

Great fit if you need a VLA policy that runs at high frequency on consumer GPUs (e.g., real-time robot manipulation or deployment on edge-like rigs) and care about low per-step latency and VRAM. TurboVLA is attractive when end-to-end LLM reasoning is unnecessary and when you can design task-conditioned vision-language interactions.

Look elsewhere if your task requires extensive natural-language reasoning, complex multi-step planning best expressed in language tokens, or heavy reliance on emergent LLM capabilities; TurboVLA trades some of the generality of an LLM-centered interface for efficiency and tighter action-conditioned representations.

Where It Fits

TurboVLA sits between heavyweight LLM-centric VLA policies (higher flexibility, higher cost) and purely reactive visuomotor policies (lower cost, less language grounding). It targets the sweet spot for multimodal robotic control where grounded language instructions matter but LLM-scale reasoning at runtime is not essential.

Information

  • Websitearxiv.org
  • AuthorsHengyi Xie, Chenfei Yao, Xianjin Wu, Xuanyang Xi, Yiping Tang, Di Xu, Yingying Zhu, Dingkang Liang, Xiang Bai, Han Ding
  • Published date2026/07/29

More Items

Simulates closed-loop interactions between people and wearable AI assistants to test whether multimodal models can guide real-world tasks. Its 120 multi-turn benchmark tasks are scored against verifiable simulator states.

Infers implicit user intent from continuous video and adapts both response timing and content as goals change. Its benchmark covers explicit, implicit, and dynamic intents, while hierarchical memory tracks state across sustained interactions.

Connects scene understanding, long-horizon visual planning, and robot control by alternating language reasoning with video prediction. An agentic variant learns when generated visual evidence is worth using.