Predicts future egocentric video from actions for human and robot embodiments. It represents movement with camera poses and manipulation with projected skeletons, trained on a unified collection of human and robot experience.
Uses natural language to describe actions and visual changes, letting one predictor learn from simulation, robot trajectories, images, and videos. It supports cross-domain planning and can initialize robot policies.