Provides 1,021.64 hours across 597 CAD/BIM workflows with synchronized screen recordings and interaction logs; each workflow includes video, timestamped input events, task specs, source files, final outputs, and evaluation rubrics for training or evaluating desktop CAD agents.
Continues a live or ongoing video stream while applying user-specified edits on the fly using a lightweight edit-ignition adapter. The adapter injects edits only in chunks where requests arrive and uses history cross-attention and temporal causal self-attention to preserve continuity and stability for unbounded streaming edits.
Benchmarks assistant-style, multi-turn interaction for omni-modal LLMs on real-time video by reverse-engineering Internet clips into guided multi-turn interactions. It provides predefined priors and segment-level constraints so models must follow exact routes while being evaluated on answer correctness, timing, visual-prompt handling, and context retention.
Generates enterable omnimodal world-model rollouts that follow continuous 6-DoF camera control while jointly producing 720p video, environmental sound, music and speech. Uses dataset-level motion calibration, a specialized data engine, progressive training and autoregressive post-training to support long-horizon first- and third-person interaction.
Conditions a MiniMax‑H3 video generator with a single ControlNet‑Union checkpoint to accept Canny, Depth, HED, MLSD or Pose control videos and run video inpainting. Guidance‑distilled for one‑pass inference; requires the base MiniMax‑H3 weights and specific control-branch config.
Generates L2-normalized multimodal embeddings (default 4,096‑D) for text, images, videos and visual documents, supporting interleaved inputs and flexible dimension truncation (Matryoshka). Designed for cross-modal retrieval, ranking and downstream retrieval systems; audio is not supported.
Generates unified embeddings for text, images, video, visual documents and interleaved multimodal inputs with configurable output dimensions and Matryoshka truncation to trade accuracy for cost. Model weights and code are released under Apache-2.0; the 9B variant scores 80.6 on MMEB-v2.
Provides Parallel Decoding Distillation (PDD) LoRA adapters that accelerate MiniMax-H3 video generation into few inference steps. Includes official 8-step Acc LoRAs for FL2VA and Ref2VA (rank=64, network_alpha=64, BF16), demo comparison videos, and example scripts using Diffusers' MiniMax-H3 ModularPipeline.
Measures whether video generators reproduce the correct distribution of possible physical behaviors under repeated rollouts. Introduces PAWBench and PAWEval to convert repeated generations into outcome-level empirical distributions and quantify probabilistic alignment; evaluates 50 scenarios and 11 models and finds no model consistently matches reference probabilities.
Rewrites physical scenes as executable world programs (e.g., MuJoCo scene descriptions) and uses an agentic abductive loop to propose, execute, render, verify, and iteratively refine those programs from videos or text. Verified executable worlds supply scalable physical supervision for training vision–language models.
Provides a unified, camera-conditioned, multi-source video dataset and reproducible processing pipeline for training long-horizon video world models. Key features: a canonical frame-aligned contract (visuals, camera geometry, captions, quality metadata), 1.43M canonical clips with portable releases and reconstruction tools; large download and some backbone assets carry separate licenses.
Generates synchronized native 2K audio-video from a single first frame and a text prompt using a compact 7B joint generator. Combines gated cross-modal attention, progressive joint training, audio-video reinforcement learning, and an Autoregressive 1-Step 2K Refinement; releases a 7B generator and 2K Refiner for research use.