Generates humanoid robot motion references that preserve object contact locations/timing by solving windowed trajectory optimizations against contact targets in the object frame. Releases retargeted trajectories for two Unitree robots across 75 objects (≈13.9k robot–motion pairs); CC BY‑NC‑SA 4.0.
Uses a compact discrete-action interface (translation, rotation, gripper) to let frozen vision–language models control robots in closed-loop, and leverages in-context (one-shot) demonstrations to substantially improve manipulation success without robot-specific training.
Teaches vision-language models to predict and integrate physical-world state transitions from interaction trajectories (observation → action → next observation). Introduces a three-level curriculum and the LSI-108K dataset, and applies supervised fine-tuning plus on-policy distillation to improve local transition modeling and long-horizon spatial integration.
Provides a unified benchmark and a spatially aware omni-modal model for spatial audio-visual reasoning in embodied agents — OmniEchoBench (197 scenes, 2,972 QA pairs; 900 FOA-based navigation tasks) plus OmniEcho, which adds an FOA spatial encoder to a pretrained semantic audio pathway to enable spatial QA and sound-guided navigation.
Provides a unified data and evaluation suite for measuring gameplay capabilities across short, medium, and long temporal horizons. Includes an automated annotator, a 5,000-hour AAA gameplay dataset with temporally aligned frames, actions and multi-horizon instructions, and a reproducible offline + stepwise online benchmark.
Evaluates whether generative world models maintain consistent, controllable, and physically plausible simulated environments under exploration, interaction, and intervention. Introduces a six-level W1–W6 capability taxonomy across three tracks (video, spatial, embodied) with human A/B Arena and automated metrics to measure behavioral correctness.
Provides imagined interaction segments generated by world models for RoboTwin2.0 tasks, stored as fixed-length HDF5 chunks (21 observation frames, 20 actions, rewards and episode flags). Useful for training and evaluating world-model-based policies; currently limited to the RoboTwin2.0 subdataset.
Learns joint predictive visual dynamics and action generation for generalist robot manipulation, translating future-relevant visual representations into actions. Integrates a Mixture-of-Transformers coupling a video expert and action expert, a frozen vision-language model for semantics, 4D distillation, and Causal Imprint; pretrained on a 20K+ hour heterogeneous corpus.
Uses 360° panoramic observations to improve vision-and-language navigation by predicting longer action sequences, confidence-guided execution, and combined semantic–geometric panorama features; yields large SR gains on R2R-CE and RxR-CE Val-Unseen.
Records structural priors with skill-specific policies so a runtime agent can select and compose the version of each skill best suited to new states, improving out-of-distribution and compositional generalization for robot manipulation from few demonstrations.
Multimodal real-robot dataset of 28,993 teleoperated bimanual manipulation demonstrations (~300 hours) with synchronized multi-view RGB/tactile videos, 65D robot state/action, 60D fingertip tactile signals, and temporally aligned language segments; intended for imitation, visuomotor and visual‑tactile research, CC BY‑NC 4.0 (non‑commercial).
Lets general-purpose vision-language models directly command robots via a compact mid-level action interface and asynchronous monitoring, enabling zero-shot manipulation without task-specific policy training; demonstrates strong sim benchmarks and real xArm6 transfer.