AI Video Papers2026
Introduces SemComp-Bench: a benchmark and VLM-based evaluation protocol for measuring outcome achievement and task-relevant semantic grounding in instruction-driven video generation. Ships with SemComp-Data, curated image–instruction–outcome triplets and OA/GR scoring.
AI Video Papers2026
Yunheng Li, Guohong Mu +5VCIP, School of Computer Science, Nankai University, Brain and Artificial Intelligence Lab, Northwestern Polytechnical University +2
Treats human annotations as oracle rollouts and separates them from on-policy baselines to improve reinforcement learning for video multimodal LLMs. Key features include a decoupled advantage estimator, sign-balanced pruning, and scalable gains across model sizes and data budgets.
AI Video Papers2026
Yudong Jin, Tao Xie +7Affiliation: State Key Lab of CAD&CG, Zhejiang University, Hangzhou, China, Affiliation: Robbyant, Hangzhou, China +4
Turns an uncalibrated monocular actor video into multiview-consistent novel-view videos and lifts them into 4D Gaussian Splatting assets. Introduces Reference Context Packing to keep reference conditioning fixed-size and Target Context Routing to exchange context across target groups, improving large-view reconstruction consistency.
Generates group images that bind up to ten reference identities to distinct people and locations by predicting an explicit identity–layout plan and supervising faces with Layout-Grounded ID Loss. Improves identity fidelity while cutting copy-paste duplication; suited for multi-person image synthesis but requires identity-annotated face regions and paired training data.
AI Video Papers2026
Continues a live or ongoing video stream while applying user-specified edits on the fly using a lightweight edit-ignition adapter. The adapter injects edits only in chunks where requests arrive and uses history cross-attention and temporal causal self-attention to preserve continuity and stability for unbounded streaming edits.
AI Video Papers2026
Generates enterable omnimodal world-model rollouts that follow continuous 6-DoF camera control while jointly producing 720p video, environmental sound, music and speech. Uses dataset-level motion calibration, a specialized data engine, progressive training and autoregressive post-training to support long-horizon first- and third-person interaction.
Generates unified embeddings for text, images, video, visual documents and interleaved multimodal inputs with configurable output dimensions and Matryoshka truncation to trade accuracy for cost. Model weights and code are released under Apache-2.0; the 9B variant scores 80.6 on MMEB-v2.
Converts image-level rewards into explicit intermediate targets for diffusion-model denoising via an on-policy self-distillation loop. Constructs bounded positive/negative targets around anchors from reward gradients, fits those targets with finite updates, and refreshes a behavior policy by EMA—improving aligned performance across backbones while reducing GPU hours.
AI Model2026
Integrates a pretrained vision–language model with a BEV perception head and a Planning Expert to provide 3D perception, driving VQA and motion planning for autonomous driving while keeping the base VLM architecture unchanged.
Performs causal, bounded‑memory streaming 3D reconstruction by caching KV features from only the preceding 11 frames, predicting a per‑frame point map and adjacent relative pose, and composing these local predictions into a global trajectory; includes a lightweight rotation refiner and composition‑aware loss to limit drift.
AI Video Papers2026
Measures whether video generators reproduce the correct distribution of possible physical behaviors under repeated rollouts. Introduces PAWBench and PAWEval to convert repeated generations into outcome-level empirical distributions and quantify probabilistic alignment; evaluates 50 scenarios and 11 models and finds no model consistently matches reference probabilities.
Turns a flow-matching image generator's self-exploration into dense, per-step supervision without a pretrained teacher; it branches the student's next-state into stochastic SDE candidates, scores them against a deterministic self-reference, and applies an advantage-weighted pull–push velocity regression with reward-level fusion for multi-objective alignment.