Evaluates and trains multimodal agents to construct interactive 3D open worlds from user queries — provides a large benchmark of assets, seed worlds, and reverse-synthesized queries plus a sandbox RL gym for tool-driven editing and rubric-based verification. Reports that frontier MLLMs perform under 60% and that RL fine-tuning improves precise 3D editing.
Trains a foundation GUI agent using a closed-loop, environment-grounded data stack plus in-context multimodal demonstrations to automate long-horizon desktop workflows. Combines scalable task generation/verification, subtask-level demo guidance, and a 100-task OSWorkerBench benchmark to improve strict success and task progress.
Automates evaluation of visual world models via a hierarchical agent pipeline that decomposes each case, spawns specialized sub-agents to collect diagnostic evidence, and outputs a verifiable evidence tree plus a final verdict; validated on 18 models across 330 cases and released as a live evaluation pipeline.