Trains video diffusion models to use multimodal language-model representations for generating video from sparse inputs and controlling factors such as characters, scenes, actions, and camera movement.
Handles coding and general tasks through command-line tools, with multi-stage training, reinforcement learning, and distillation aimed at reliable tool use and long-horizon execution.
Unifies detection, localization, counting, and OCR with segmentation and matting in one vision-language model, using structured tokens for coordinates and pixel-level outputs.