Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models
Proposes VLAct, a representation-centric continued pre-training method for Vision-Language-Action models that preserves VLM priors and enforces cross-embodiment action semantics to turn limited robot trajectories into transferable visual-action representations; shows strong gains and sample efficiency on multiple VLA benchmarks using modest compute.
Generates synchronized spoken dialogue and explicit full-body co-speech motion (facial expressions, hands, upper- and lower-body) end-to-end from the same hidden states, replacing the speech-then-motion cascade. Trains with a scalable pseudo-labeling pipeline (422,856 ranked pairs) and supports real-time inference (RTF 0.78) while matching teacher motion metrics within ~2%.
Converts posed indoor RGB(-D) video into editable, simulation-ready 3D scene graphs by parsing multi-view evidence into per-object bundles, generating complete object assets from that evidence, and placing them with GizmoAct, a VLM policy that refines 9-DoF poses through closed-loop GUI actions.
Embodied AI2026
Learns generalizable World Action Models for robotic manipulation by scaling causal egocentric video pretraining and grounding learned dynamics with heterogeneous robot trajectories. Key features: a three-stage curriculum (video pretraining, video-action mid-training with a unified action representation, and target-robot specialization) and a Slow–Fast dual-system for 30 Hz real-time action prediction.
Embodied AI2026
Wei Wang, Wenqiao Zhang +15Affiliation: College of Computer Science and Technology, Zhejiang University, Affiliation: Nanjing University of Aeronautics and Astronautics +4
Wraps vision–language–action policies into executable skills that are runtime-validated, executed as bounded low-level action chunks, outcome-verified, and logged as structured trajectories. A fixed skill interface enables swapping or adapting low-level VLA policies and provides component-level supervision for training and optional online adaptation.
Trains a world-action model that predicts future visual states to guide zero-shot robotic manipulation; introduces CoAE, SVP, IDM and KASO to pretrain generative and action components from scratch on manipulation data, scaling up to 30,000 hours and improving zero-shot success.
AI Model2026
Multimodal foundation model for visual understanding, spatial reasoning and multi-step agent tool use — accepts text, multiple images and video at any resolution and supports long contexts (up to 128K tokens). Emphasizes fine-grained 2D/3D relations, affordance reasoning and embodied-AI planning.
Trains LVLMs to improve 3D spatial reasoning using a synthetic block-stacking dataset of 15,000 problems that cover 3D→2D projection, viewpoint transforms, and structural combination; includes color-anchored cues and provides code and data.
AI Agent Papers2026
Lets vision-language models control robots via a compact semantic action interface that maps intent to discrete action units; supports zero-shot use of closed-source VLMs, low-cost fine-tuning of open VLMs, and GUI-based demonstration collection.
AI Dataset2026
Simulation-ready home dataset for embodied AI: CAD-based household scenes with configured physical properties and metadata, plus 1,000 robot trajectory episodes (RGB-D, HDF5/USDZ) for simulation training and evaluation under CC BY-NC-SA 4.0.
AI Dataset2026
Provides 1,274 hours of head-mounted egocentric video paired with seven-point IMU arm tracking (24 Hz orientation; raw accel/gyro/mag on a subset), packaged for embodied-AI and egocentric-vision research. Key features: torso-relative pose via chest reference, separate Parquet IMU repo for efficient joins, CC-BY-4.0 license; heavy class skew and limited contributor diversity are important constraints.
Introduces physical rank consistency (PRC) and ActionPiece, a learned action tokenizer that preserves local physical relationships via joint supervision of representation learning and quantization, improving autoregressive vision-language-action policy performance across multiple benchmarks.