Converts image-content removal into a contrastive on-policy self-distillation signal: the EMA teacher produces next-token distributions with and without image content, uses their log-probability differences to sharpen visual-grounded candidates, and distills that full-distribution target into the student—no external teacher or extra inference cost.
AI Video Papers2026
Real-time streaming multimodal foundation model that uses a codec-native tokenizer (Mage-ViT) to encode motion- and residual-rich regions from video I/P frames, reducing visual token usage by over 75% and enabling up to ~3.5× wall-clock inference speedup after training on ~560M images and 100M video frames.
A pretrain-then-transfer method for streaming recommendation that decouples refreshable behavioral knowledge from task-specific geometry to enable continual model refresh without downstream interference; introduces Behavioral Multi-Token Prediction and Anchored Calibration Residual and shows 4–12% offline gains plus live Shopee A/B lifts.
AI Dataset2026
Provides 1,000 five-second video clips generated by MiniMax H3 for lightweight evaluation of multimodal generation and understanding. Clips are roughly 768p base resolution with diverse aspect ratios and themes, produced with a pruned int8 minimax_h3_fl2va checkpoint at 30 steps.
Performs causal, bounded‑memory streaming 3D reconstruction by caching KV features from only the preceding 11 frames, predicting a per‑frame point map and adjacent relative pose, and composing these local predictions into a global trajectory; includes a lightweight rotation refiner and composition‑aware loss to limit drift.