AI Agent Papers2026
Orchestrates reasoning, external tool use, and native image generation under one unified multimodal agent policy via post-training. Introduces RAD-GRPO for agentic reinforcement fine-tuning and releases training data plus the full post-training infrastructure.
Systematically studies how language and vision interact during unified multimodal pretraining, identifies mechanisms that enable modality synergy versus competition, demonstrates the benefit of early joint training, and derives efficient pretraining recipes validated at scale.
AI Video Papers2026
Evaluates VLMs' ability to form global spatial awareness from long-horizon egocentric video. Introduces GST-Bench: a VQA benchmark with human-verified questions from 6,790 minutes of synthetic video, reveals a large gap (best zero-shot 42.68 vs human 79.08) and provides GST-Train dataset.
Generates retrieval-centric Chain-of-Thought (RC-CoT) over initially retrieved candidates to improve unified multimodal retrieval via reranking or full-corpus re-retrieval with a dual-mode embedder. Trains an embedder–adviser framework (UniME-R1) using mined hard negatives, supervised learning, and retrieval-oriented reinforcement learning.
AI Video Papers2026
Uses video generation only as a training signal to co-train a pretrained video expert and a lightweight action expert, then discards the video branch at inference to produce a low-latency end-to-end driving planner; enhanced with RL for compositional driving rewards.
Turns adapter placement for PEFT on YOLO-family real-time detectors into an auditable constraint-planning problem that emits budgeted target-module plans or calibrated refusals; shows planner-selected RS-LoRA improves mAP and cuts peak training memory in evaluated detectors.
Post-training distribution-level objective that augments static Fréchet-distance losses with an adversarially learned representation and a real-feature whitening step to stabilize min–max optimization and avoid trivial feature amplification; targets one-step image generator post-training.
AI Video Papers2026
Chuyue Li, Jinpeng Yu +8Affiliation: Qwen Business Unit of Alibaba, Affiliation: ShanghaiTech University +3
Encodes videos into a Film Knowledge Graph and reconstructs them to learn agent-native, editable video representations for agentic reasoning and manipulation. Uses agentic auto-encoding with dual-loop textual-gradient optimization, reports large reconstruction gains, and releases a benchmark and dataset.
Builds an editable, persistent 3D world state to drive iterative previsualization for film, games, and design — enabling local edits and recombinations instead of one-shot video regeneration. Uses separate stages for state construction, state evolution, and state access, with render-feedback camera refinement.
AI Video Papers2026
Externalizes persistent scene state into a camera-indexed world bank and designs a long-horizon teacher whose sparse-attention supervision is distilled into a three-step student, enabling responsive, low-latency interactive long-horizon video generation with bounded denoiser context.
AI Video Papers2026
Predicts future video frames conditioned on an observed frame, a language instruction, and a sequence of end-effector poses and gripper states for robot manipulation. Uses per-arm SE(3) geometric encoding (PRoPE-style), a lightweight depth branch, SAM3 masks with a frozen V-JEPA teacher, and distribution-matching distillation for efficient, consistent action-conditioned rollouts.
Provides a large-scale benchmark and a human-aligned metric for humanoid whole-body motion tracking — about 153 hours of optical mocap from professional performers plus HumanScore trained on 12K human-labeled preference pairs to reveal contact, timing, and stability failures.