Extrapolates long video sequences from very short contexts by restoring memory-writing supervision in autoregressive video diffusion models using a two-pass Self Gradient Forcing (SGF). SGF records a no-gradient rollout at a sampled denoising exit and then recomputes KV context in a second parallel pass so future losses teach earlier latent writes, enabling minutes-long extrapolation from ~5s windows.
Generates synchronized audiovisual output from text, image, or audio prompts — a diffusion-based multimodal model with componentized weights (video/audio VAEs, multilingual text encoder, distilled transformer) and ready integration with HuggingFace pipelines and ComfyUI.
Delivers image and video understanding plus a built-in event‑gated streaming gate — a unified 4B multimodal foundation model that uses codec-aligned tokenization to cut visual tokens by >75% and yield up to 3.5× wall‑clock inference speedup for streaming and long‑horizon video tasks.
Generates synchronized stereo audio and video from multimodal inputs (text, images, video, audio), producing 4–15s clips at 24 FPS with a 768p base and an in‑context regeneration path to 2K; supports first/last‑frame and multi‑reference modes and ships as two task‑specific checkpoints.
Converts text prompts into physically consistent videos by synthesizing executable Blender programs as a process-level chain-of-thought and using a dual-engine pipeline (deterministic simulation draft + draft-conditioned video editor). Ships with a VideoCoCo-3K draft–instruction–target dataset and shows substantial gains in physical-consistency benchmarks.
Learns a discrete “physical language” from unlabeled videos and uses a reason-then-render pipeline: predict compact state-transition tokens, then decode them into future video. Separates dynamics inference from pixel synthesis to improve physical fidelity, controllable simulation, and zero-shot motion transfer.
Provides 30,969 action-conditioned video episodes, each with source MP4, per-frame keyboard control logs, captions, and a COLMAP sparse pose model — intended for research on action-conditioned video prediction, controllable world models, and representation learning.
Provides GGUF-quantized, ComfyUI-ready MiniMax‑H3 model files (FL2VA/REF2VA, text encoder, audio/video VAEs) to enable local ComfyUI inference for short video + stereo audio generation; requires the official VAEs and sufficient VRAM.
Introduces WorldExam, a diagnostic benchmark that evaluates controllable video world models across four levels from visual quality to inherent world reactivity. Covers 1,474 cases across eight tasks and supports camera-, action-, and language-driven paradigms, measuring scene-conditioned reactions beyond explicit instructions.
Installation-oriented dataset that packages ComfyUI-ready files and instructions for running MiniMax H3 locally — includes pruned/INT8/BF16 checkpoints, matching Qwen3-VL text encoders, video/audio VAEs, and official ComfyUI workflow templates for joint audio+video generation.
Performs real-time, instruction-guided video-to-video editing on streaming input using a 16B autoregressive diffusion model that preserves subject identity and long-term temporal coherence; achieves end-to-end 720p at ≈30 FPS on a single Nvidia B200 GPU. Key features include chunk-wise autoregressive adaptation, Source-Anchored Distribution Matching Distillation (SA-DMD) that reduces diffusion to a two-step generator, and Long-Horizon Autoregressive Distillation to mitigate temporal drift.
A quickly trained 2D "tine" VAE for MiniMax‑H3 that speeds up preview renders of video outputs and typically outperforms latent2rgb for preview use. Currently only compatible with the ModelPreviewOverride node in ComfyUI‑KJNodes and intended for previewing rather than production-grade decoding.