Evaluates whether vision-language models can make actionable decisions for a physical body by decoupling decision-making from low-level motor execution. Introduces HumanCLAW-Bench with 1,218 long-horizon egocentric episodes across 41 indoor scenes and diagnoses a lack of embodied self-awareness in current VLMs.
Learns a discrete “physical language” from unlabeled videos and uses a reason-then-render pipeline: predict compact state-transition tokens, then decode them into future video. Separates dynamics inference from pixel synthesis to improve physical fidelity, controllable simulation, and zero-shot motion transfer.
Regularizes latent world models by replacing the Epps–Pulley Gaussianization objective with a quantile–quantile matching loss that aligns projected latent samples to rank-matched Gaussian quantiles, improving tail correction and planning success via cross-batch ranking.
Provides time-aligned simulated urban driving recordings that pair high-rate CSI/CIR with multi-view cameras, LiDAR, radar, IMU and GNSS for perception-to-channel research; contains 100 validated 1-second samples produced with CARLA and Sionna, but is limited in scene diversity and real-world fidelity.
Uses video generation only as a training signal to co-train a pretrained video expert and a lightweight action expert, then discards the video branch at inference to produce a low-latency end-to-end driving planner; enhanced with RL for compositional driving rewards.
10,000-hour head-and-wrist egocentric dataset pairing synchronized head and wrist video with left/right 3D hand pose and optional full-body pose; provided in LeRobot/MCAP formats with episode-level semantic annotations and automated de-identification.
A small public sample of egocentric human demonstration video with synchronized 3D hand and body pose annotations for imitation learning and embodied-AI research. Delivered in Parquet and common multimodal packages (LeRobot, MCAP) for schema inspection before requesting gated access to larger EgoSuite releases.
Provides 90,000 hours of head-mounted egocentric video paired with synchronized 3D hand pose and an optional 3D full‑body pose add-on, with event-level semantic labels available as a complimentary layer — designed for embodied AI and robotics training at scale.
Predicts future video frames conditioned on an observed frame, a language instruction, and a sequence of end-effector poses and gripper states for robot manipulation. Uses per-arm SE(3) geometric encoding (PRoPE-style), a lightweight depth branch, SAM3 masks with a frozen V-JEPA teacher, and distribution-matching distillation for efficient, consistent action-conditioned rollouts.
Provides a large-scale benchmark and a human-aligned metric for humanoid whole-body motion tracking — about 153 hours of optical mocap from professional performers plus HumanScore trained on 12K human-labeled preference pairs to reveal contact, timing, and stability failures.
Provides 617.5 hours of high-precision optical motion-capture with synchronized object trajectories and standardized 55-joint BVH for whole-body and human–object interaction research. Frame‑LU indexed and paired with natural-language descriptions; designed for humanoid learning, motion priors, and interaction-aware benchmarks.
Enables closed-loop execution for embodied agents by evolving code-based runtime critics and recovery skills online while keeping the base policy frozen. Combines three timescale loops with Z-Infra rollout infrastructure; reports 90.8% on LIBERO-Pro, 93.6% on RoboCasa and an 11.1× inference speedup.