AI Video Papers2026
Generates enterable omnimodal world-model rollouts that follow continuous 6-DoF camera control while jointly producing 720p video, environmental sound, music and speech. Uses dataset-level motion calibration, a specialized data engine, progressive training and autoregressive post-training to support long-horizon first- and third-person interaction.
AI Video2026
Conditions a MiniMax‑H3 video generator with a single ControlNet‑Union checkpoint to accept Canny, Depth, HED, MLSD or Pose control videos and run video inpainting. Guidance‑distilled for one‑pass inference; requires the base MiniMax‑H3 weights and specific control-branch config.
AI Video2026
Provides Parallel Decoding Distillation (PDD) LoRA adapters that accelerate MiniMax-H3 video generation into few inference steps. Includes official 8-step Acc LoRAs for FL2VA and Ref2VA (rank=64, network_alpha=64, BF16), demo comparison videos, and example scripts using Diffusers' MiniMax-H3 ModularPipeline.
AI Video Papers2026
Measures whether video generators reproduce the correct distribution of possible physical behaviors under repeated rollouts. Introduces PAWBench and PAWEval to convert repeated generations into outcome-level empirical distributions and quantify probabilistic alignment; evaluates 50 scenarios and 11 models and finds no model consistently matches reference probabilities.
Generates synchronized spoken dialogue and explicit full-body co-speech motion (facial expressions, hands, upper- and lower-body) end-to-end from the same hidden states, replacing the speech-then-motion cascade. Trains with a scalable pseudo-labeling pipeline (422,856 ranked pairs) and supports real-time inference (RTF 0.78) while matching teacher motion metrics within ~2%.
AI Dataset2026
Provides a unified, camera-conditioned, multi-source video dataset and reproducible processing pipeline for training long-horizon video world models. Key features: a canonical frame-aligned contract (visuals, camera geometry, captions, quality metadata), 1.43M canonical clips with portable releases and reconstruction tools; large download and some backbone assets carry separate licenses.
AI Video Papers2026
Generates synchronized native 2K audio-video from a single first frame and a text prompt using a compact 7B joint generator. Combines gated cross-modal attention, progressive joint training, audio-video reinforcement learning, and an Autoregressive 1-Step 2K Refinement; releases a 7B generator and 2K Refiner for research use.
AI Video2026
Replaces a character in a video using a single repainted frame from the same clip and propagates that edit across the shot while preserving motion, camera and lighting; requires no pose estimator, segmentation, face tracker or text prompt. Key facts: a 33.1B MiniMax-H3 finetune, DMD-distilled to three forward passes, 124 frames in ~26s on one B200 GPU.
Embodied AI2026
Learns generalizable World Action Models for robotic manipulation by scaling causal egocentric video pretraining and grounding learned dynamics with heterogeneous robot trajectories. Key features: a three-stage curriculum (video pretraining, video-action mid-training with a unified action representation, and target-robot specialization) and a Slow–Fast dual-system for 30 Hz real-time action prediction.
AI Dataset2026
Provides an unattended text-to-video-and-audio streaming toolkit built around FastH3 (a 4-step distillation of MiniMax-H3): generation/retime/HTTP push scripts, a 221-scene prompt library, checkpoint conversion and ComfyUI workflows to run a continuous local stream.
AI Video2026
Adds a plug-and-play linear-attention branch and LoRA adapters to MiniMax-H3 to run text-to-video generation faster than real-time (near-lossless quality tradeoffs). Includes an optimized FP8 inference stack and a community license with regional restrictions.
AI Dataset2026
Provides 4.5 billion TikTok video records with captions, timestamps, music IDs and engagement counts for research; split across 27 zstd-compressed Parquet files (~289 GB) and sampled via TikTok's mobile API; released for research-use only with privacy and ToS caveats.