Turns a robot calibration episode and data request into synchronized, action-labelled training data: an agent builds the simulated task, while a video model renders realistic observations. Across five robot tasks, farm-trained policies scored 87 successes under unseen appearances, versus 46 for teleoperation-trained policies.
Converts 1,033 Google Scanned Objects household scans into web-ready GLB files, with KTX2 textures, LODs, and collision hulls for 3D scenes and simulation.
Lets robot manipulation policies draw on visual representations from different depths of a vision-language backbone instead of relying on a separate encoder’s fixed output. The approach improves control results on LIBERO and real-world tasks.