AI Video Papers2026
Yunheng Li, Guohong Mu +5VCIP, School of Computer Science, Nankai University, Brain and Artificial Intelligence Lab, Northwestern Polytechnical University +2
Treats human annotations as oracle rollouts and separates them from on-policy baselines to improve reinforcement learning for video multimodal LLMs. Key features include a decoupled advantage estimator, sign-balanced pruning, and scalable gains across model sizes and data budgets.
Adapts off-policy RL stabilizers to the available data regime: introduces WarpSAC, a regime-aware family using Sample Weight Decay plus two regime-matched variants (WarpSAC-L and WarpSAC-A) to improve sample efficiency, wall-time learning, and sim-to-real deployment.
AI Agent Papers2026
Proposes Recuris, a recursive Experiential-Working Memory architecture that separates Working Memory (task progress) from Experiential Memory (skills) and uses a Meta-Agent to validation-gate localized skill updates, enabling bounded recursive skill evolution for long-horizon agents.
Converts image-level rewards into explicit intermediate targets for diffusion-model denoising via an on-policy self-distillation loop. Constructs bounded positive/negative targets around anchors from reward gradients, fits those targets with finite updates, and refreshes a behavior policy by EMA—improving aligned performance across backbones while reducing GPU hours.
AI Agent Papers2026
Proposes treating game development as a recursive data engine and introduces RLHEV (Reinforcement Learning with Human-Engine Verification) to combine dense engine checks (collision, physics, navigability) with human acceptance feedback, producing trajectory data and rewards for post-training world models.
Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models
Proposes VLAct, a representation-centric continued pre-training method for Vision-Language-Action models that preserves VLM priors and enforces cross-embodiment action semantics to turn limited robot trajectories into transferable visual-action representations; shows strong gains and sample efficiency on multiple VLA benchmarks using modest compute.
AI Agent Papers2026
Trains LLM agents to proactively edit and manage their working context for long-horizon tasks using an expanded toolset (planning, long-term memory, soft offloading) and a fine-grained RL algorithm that identifies critical edits and assigns action-level credit. Improves accuracy while keeping contexts compact on long-context QA and deep search.
Analyzes on-policy distillation for LLM fine-tuning, shows teacher token-level supervision is often noisy and not the main driver of gains, and introduces OPSA, a supervision-free, entropy-adaptive method that suppresses low-probability tokens to improve downstream accuracy.
AI Agent Papers2026
Turns each research paper into a training environment to generate verifiable research plans by synthesizing questions from goals/background and deriving evaluation criteria from methods/experiments. Key features: four-stage extraction that reduces criterion leakage to 3.7%, a two-stage rubric-centered training (self-distillation then GRPO), and the PaperGym-20k corpus with two held-out benchmarks.
Generates compact keyword sets for both queries and items with LLMs and matches them directly via an inverted index. Uses supervised fine-tuning to align keyword spaces, then alternates GRPO-based reinforcement learning on query- and item-side generators to co-evolve representations and maximize retrieval F1 while staying compatible with keyword-based infrastructure.
Selectively admits dense token-level teacher supervision only after a prompt-level verifier audit, routing prompts that fail the audit to verifier-grounded trajectory supervision instead — reducing harmful updates from confidently wrong teachers and improving teacher GPU utilization.
Combines sparse verifier outcomes with dense privileged‑hindsight token scoring to learn an outcome‑calibrated, normalized distribution over complete responses for on‑policy self‑improvement. Key features: sign‑gated guidance (retain/reverse/disable per verifier advantage), profiled trajectory balance with one log‑partition per rollout group, and explicit correction against false‑positive self‑guidance.