AI Video Papers2026
Automates evaluation of visual world models via a hierarchical agent pipeline that decomposes each case, spawns specialized sub-agents to collect diagnostic evidence, and outputs a verifiable evidence tree plus a final verdict; validated on 18 models across 330 cases and released as a live evaluation pipeline.
AI Video Papers2026
Introduces SemComp-Bench: a benchmark and VLM-based evaluation protocol for measuring outcome achievement and task-relevant semantic grounding in instruction-driven video generation. Ships with SemComp-Data, curated image–instruction–outcome triplets and OA/GR scoring.
AI Video Papers2026
Yunheng Li, Guohong Mu +5VCIP, School of Computer Science, Nankai University, Brain and Artificial Intelligence Lab, Northwestern Polytechnical University +2
Treats human annotations as oracle rollouts and separates them from on-policy baselines to improve reinforcement learning for video multimodal LLMs. Key features include a decoupled advantage estimator, sign-balanced pruning, and scalable gains across model sizes and data budgets.
AI Video Papers2026
Evaluates visual reasoning in video generation models using 27 photorealistic tasks (810 instances), a two-level taxonomy of domains and skill tags, and task designs that enforce valid intermediate trajectories and calibrated difficulty.
AI Video Papers2026
Yudong Jin, Tao Xie +7Affiliation: State Key Lab of CAD&CG, Zhejiang University, Hangzhou, China, Affiliation: Robbyant, Hangzhou, China +4
Turns an uncalibrated monocular actor video into multiview-consistent novel-view videos and lifts them into 4D Gaussian Splatting assets. Introduces Reference Context Packing to keep reference conditioning fixed-size and Target Context Routing to exchange context across target groups, improving large-view reconstruction consistency.
AI Video Papers2026
Continues a live or ongoing video stream while applying user-specified edits on the fly using a lightweight edit-ignition adapter. The adapter injects edits only in chunks where requests arrive and uses history cross-attention and temporal causal self-attention to preserve continuity and stability for unbounded streaming edits.
AI Video Papers2026
Xianyun Sun, Chaoyou Fu +7Affiliation: Project Leader & Corresponding AuthorProject Page: https://xianyunsun.github.io/OmniAssistBench/, Affiliation: Nankai University +1
Benchmarks assistant-style, multi-turn interaction for omni-modal LLMs on real-time video by reverse-engineering Internet clips into guided multi-turn interactions. It provides predefined priors and segment-level constraints so models must follow exact routes while being evaluated on answer correctness, timing, visual-prompt handling, and context retention.
AI Video Papers2026
Generates enterable omnimodal world-model rollouts that follow continuous 6-DoF camera control while jointly producing 720p video, environmental sound, music and speech. Uses dataset-level motion calibration, a specialized data engine, progressive training and autoregressive post-training to support long-horizon first- and third-person interaction.
AI Video Papers2026
Measures whether video generators reproduce the correct distribution of possible physical behaviors under repeated rollouts. Introduces PAWBench and PAWEval to convert repeated generations into outcome-level empirical distributions and quantify probabilistic alignment; evaluates 50 scenarios and 11 models and finds no model consistently matches reference probabilities.
AI Video Papers2026
Generates synchronized native 2K audio-video from a single first frame and a text prompt using a compact 7B joint generator. Combines gated cross-modal attention, progressive joint training, audio-video reinforcement learning, and an Autoregressive 1-Step 2K Refinement; releases a 7B generator and 2K Refiner for research use.
AI Video Papers2026
Provides an end-to-end, reproducible foundation for camera‑controllable, long‑horizon video world models — converting 1.43M clips from 10 datasets into a unified canonical corpus and releasing data, pipelines, recipes, and weights. Introduces backbone‑native adaptation and a three‑stage training recipe to produce 5B–33B models that enable minute‑to‑hour rollouts after training on 5s sequences.
AI Video Papers2026
Translates natural-language instructions into executable programs that maintain an explicit, persistent global world state and compiles state-augmented 3D oriented bounding boxes into pixel-aligned conditioning signals for pretrained video generators. The approach decouples state evolution from rendering, enabling programmable entity control, off-screen state, and long-horizon interactive scenarios.