AI Video Papers2026
Generates synchronized native 2K audio-video from a single first frame and a text prompt using a compact 7B joint generator. Combines gated cross-modal attention, progressive joint training, audio-video reinforcement learning, and an Autoregressive 1-Step 2K Refinement; releases a 7B generator and 2K Refiner for research use.
AI Video2026
Replaces a character in a video using a single repainted frame from the same clip and propagates that edit across the shot while preserving motion, camera and lighting; requires no pose estimator, segmentation, face tracker or text prompt. Key facts: a 33.1B MiniMax-H3 finetune, DMD-distilled to three forward passes, 124 frames in ~26s on one B200 GPU.
Embodied AI2026
Learns generalizable World Action Models for robotic manipulation by scaling causal egocentric video pretraining and grounding learned dynamics with heterogeneous robot trajectories. Key features: a three-stage curriculum (video pretraining, video-action mid-training with a unified action representation, and target-robot specialization) and a Slow–Fast dual-system for 30 Hz real-time action prediction.
AI Dataset2026
Provides an unattended text-to-video-and-audio streaming toolkit built around FastH3 (a 4-step distillation of MiniMax-H3): generation/retime/HTTP push scripts, a 221-scene prompt library, checkpoint conversion and ComfyUI workflows to run a continuous local stream.
AI Video2026
Adds a plug-and-play linear-attention branch and LoRA adapters to MiniMax-H3 to run text-to-video generation faster than real-time (near-lossless quality tradeoffs). Includes an optimized FP8 inference stack and a community license with regional restrictions.
AI Dataset2026
Provides 4.5 billion TikTok video records with captions, timestamps, music IDs and engagement counts for research; split across 27 zstd-compressed Parquet files (~289 GB) and sampled via TikTok's mobile API; released for research-use only with privacy and ToS caveats.
AI Video Papers2026
Provides an end-to-end, reproducible foundation for camera‑controllable, long‑horizon video world models — converting 1.43M clips from 10 datasets into a unified canonical corpus and releasing data, pipelines, recipes, and weights. Introduces backbone‑native adaptation and a three‑stage training recipe to produce 5B–33B models that enable minute‑to‑hour rollouts after training on 5s sequences.
AI Video2026
Generates short multimodal videos from text, images, or reference clips using a fine-tuned MiniMax‑H3 fusion model; improves HDR clarity, motion fluidity, distant-face fidelity and VFX while preserving MiniMax‑H3’s prompt/style behavior. Best used via ComfyUI.
AI Video2026
LoRA adapters for MiniMax H3 that sharpen and enhance videos in ComfyUI by conditioning on source clips via guide latents for pixel-level alignment. Designed mainly for ref2va as a second-pass sharpening tool, includes a ComfyUI workflow and example before/after clips; requires aligned guide clips at the target resolution and valid clip lengths.
AI Video Papers2026
Translates natural-language instructions into executable programs that maintain an explicit, persistent global world state and compiles state-augmented 3D oriented bounding boxes into pixel-aligned conditioning signals for pretrained video generators. The approach decouples state evolution from rendering, enabling programmable entity control, off-screen state, and long-horizon interactive scenarios.
AI Dataset2026
Provides 1,274 hours of head-mounted egocentric video paired with seven-point IMU arm tracking (24 Hz orientation; raw accel/gyro/mag on a subset), packaged for embodied-AI and egocentric-vision research. Key features: torso-relative pose via chest reference, separate Parquet IMU repo for efficient joins, CC-BY-4.0 license; heavy class skew and limited contributor diversity are important constraints.
AI Dataset2026
Provides 22 curated Three.js-based cases for code-guided video generation across eight application categories. Each case bundles an editable scene (Three.js program), a 960×544 proxy video, a 1536×864 reference image, and a plain-text prompt for controlled video-generation evaluation.