AI Video Papers2026
Predicts future video frames conditioned on an observed frame, a language instruction, and a sequence of end-effector poses and gripper states for robot manipulation. Uses per-arm SE(3) geometric encoding (PRoPE-style), a lightweight depth branch, SAM3 masks with a frozen V-JEPA teacher, and distribution-matching distillation for efficient, consistent action-conditioned rollouts.
Provides a large-scale benchmark and a human-aligned metric for humanoid whole-body motion tracking — about 153 hours of optical mocap from professional performers plus HumanScore trained on 12K human-labeled preference pairs to reveal contact, timing, and stability failures.
AI Dataset2026
Provides 617.5 hours of high-precision optical motion-capture with synchronized object trajectories and standardized 55-joint BVH for whole-body and human–object interaction research. Frame‑LU indexed and paired with natural-language descriptions; designed for humanoid learning, motion priors, and interaction-aware benchmarks.
AI Agent Papers2026
Enables closed-loop execution for embodied agents by evolving code-based runtime critics and recovery skills online while keeping the base policy frozen. Combines three timescale loops with Z-Infra rollout infrastructure; reports 90.8% on LIBERO-Pro, 93.6% on RoboCasa and an 11.1× inference speedup.
Embodied AI2026
Turns embodied navigation into 2D visual prompting where a vision-language model selects image pixels that are projected to 3D actions; adds selective chain-of-thought, compressed anchor-trajectory memory, and a two-level alignment objective to improve sample and runtime efficiency.
Adapts off-policy RL stabilizers to the available data regime: introduces WarpSAC, a regime-aware family using Sample Weight Decay plus two regime-matched variants (WarpSAC-L and WarpSAC-A) to improve sample efficiency, wall-time learning, and sim-to-real deployment.
AI Model2026
Integrates a pretrained vision–language model with a BEV perception head and a Planning Expert to provide 3D perception, driving VQA and motion planning for autonomous driving while keeping the base VLM architecture unchanged.
Provides a real-scale 3D Hong Kong sandbox to evaluate whether multimodal LLM agents can turn local street-view perception into sustained spatial action, supporting closed-loop first-person interaction, an interactive map, and controlled tests of grounding, long-range navigation, and robustness.
Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models
Proposes VLAct, a representation-centric continued pre-training method for Vision-Language-Action models that preserves VLM priors and enforces cross-embodiment action semantics to turn limited robot trajectories into transferable visual-action representations; shows strong gains and sample efficiency on multiple VLA benchmarks using modest compute.
AI Dataset2026
Provides a human-verified benchmark of 1,927 heterogeneous articulated 3D objects with part-level articulation semantics and intrinsic physical-property annotations for evaluating physical grounding and simulation readiness. Includes URDF assemblies, aligned point clouds, per-part JSON annotations, and a curated evaluation protocol; licensed CC BY-NC 4.0 (non-commercial).
Converts posed indoor RGB(-D) video into editable, simulation-ready 3D scene graphs by parsing multi-view evidence into per-object bundles, generating complete object assets from that evidence, and placing them with GizmoAct, a VLM policy that refines 9-DoF poses through closed-loop GUI actions.
Embodied AI2026
Learns generalizable World Action Models for robotic manipulation by scaling causal egocentric video pretraining and grounding learned dynamics with heterogeneous robot trajectories. Key features: a three-stage curriculum (video pretraining, video-action mid-training with a unified action representation, and target-robot specialization) and a Slow–Fast dual-system for 30 Hz real-time action prediction.