Provides a unified survey of progress-reward modeling for robotic learning, detailing interfaces, modeling techniques, and evaluation practices. Organizes the literature into three perspectives—interface, model internals, and data/benchmarks—and highlights limitations and open problems. Useful for researchers designing rewards for long-horizon or sparse-reward robotic tasks.
Enables tactile-aware robot manipulation by pretraining a vision–tactile–language–action foundation model and improving offline policies with ALTER. Combines large-scale NeoData visuo-tactile pretraining, a latent tactile pathway for predictive touch signals, and advantage‑conditioned offline RL for contact-rich tasks.
Provides a portable, robot-free UMI capture pipeline and shows that policies post-trained only on this high-fidelity data deploy directly on real robots matching teleoperation baselines. Capture achieves ~3 mm end-effector accuracy, microsecond sync, ultra-wide FOV, and releases 2,000h HiFi-UMI-2K.
Captures synchronized multimodal embodied-human data in real homes — egocentric and multi-view video, metric body/hand/object motion, audio, and tactile signals. Released under a gated non-commercial research license with identifiable participants and strict non-redistribution/privacy constraints.
Runs reinforcement-learning policies on a tiny biped robot, enabling behaviors such as walking, self-righting, and picking up objects. Policies are trained in simulation and run locally on the robot.
Directly maps visual observations and language instructions to continuous robot actions, replacing LLM-centric V→L→A pipelines. Uses separate visual and language encoders with lightweight bidirectional interaction and a compact decoder to cut inference cost and VRAM, achieving ~31 ms latency and <1 GB VRAM on an RTX 4090; suited for real-time robotic manipulation under tight compute budgets.
Evaluates whether vision-language models can make actionable decisions for a physical body by decoupling decision-making from low-level motor execution. Introduces HumanCLAW-Bench with 1,218 long-horizon egocentric episodes across 41 indoor scenes and diagnoses a lack of embodied self-awareness in current VLMs.
Provides 30,969 action-conditioned video episodes, each with source MP4, per-frame keyboard control logs, captions, and a COLMAP sparse pose model — intended for research on action-conditioned video prediction, controllable world models, and representation learning.
Provides 90,000 hours of head-mounted egocentric video paired with synchronized 3D hand pose and an optional 3D full‑body pose add-on, with event-level semantic labels available as a complimentary layer — designed for embodied AI and robotics training at scale.
Predicts future video frames conditioned on an observed frame, a language instruction, and a sequence of end-effector poses and gripper states for robot manipulation. Uses per-arm SE(3) geometric encoding (PRoPE-style), a lightweight depth branch, SAM3 masks with a frozen V-JEPA teacher, and distribution-matching distillation for efficient, consistent action-conditioned rollouts.
Provides a large-scale benchmark and a human-aligned metric for humanoid whole-body motion tracking — about 153 hours of optical mocap from professional performers plus HumanScore trained on 12K human-labeled preference pairs to reveal contact, timing, and stability failures.
Enables closed-loop execution for embodied agents by evolving code-based runtime critics and recovery skills online while keeping the base policy frozen. Combines three timescale loops with Z-Infra rollout infrastructure; reports 90.8% on LIBERO-Pro, 93.6% on RoboCasa and an 11.1× inference speedup.