AI Agent Papers2026
Evaluates vision-language model judges on computer-using agent (CUA) trajectories to measure verifier reliability. Provides OSReward-Hard and OSReward-Multi challenge sets, the OS-Shepherd-100K reasoning-annotated corpus, and trained OS-Shepherd reward models that match commercial judges at ~30–60× lower cost.
AI Agent Papers2026
A 365-day, order-level simulation benchmark for evaluating long-term coherence of LLM agents in seller-side e-commerce. Grounded in 98,843 real product records and 26 interactive tools, it pairs prompt upstream supplier signals with delayed downstream order outcomes to stress planning, memory, and tool use over long horizons.
AI Agent Papers2026
Yunhao Chen, Xin Wang +7Affiliation: Fudan University, Affiliation: Shanghai Artificial Intelligence Laboratory +1
Evolves persistent, stateful environments to red-team tool-using AI agents — provides 10K+ validated scenarios across 50 domains and a feedback-driven attack policy (EMHA) to surface long‑horizon safety failures.
AI Video Papers2026
Introduces WorldExam, a diagnostic benchmark that evaluates controllable video world models across four levels from visual quality to inherent world reactivity. Covers 1,474 cases across eight tasks and supports camera-, action-, and language-driven paradigms, measuring scene-conditioned reactions beyond explicit instructions.
AI Video Papers2026
Performs real-time, instruction-guided video-to-video editing on streaming input using a 16B autoregressive diffusion model that preserves subject identity and long-term temporal coherence; achieves end-to-end 720p at ≈30 FPS on a single Nvidia B200 GPU. Key features include chunk-wise autoregressive adaptation, Source-Anchored Distribution Matching Distillation (SA-DMD) that reduces diffusion to a two-step generator, and Long-Horizon Autoregressive Distillation to mitigate temporal drift.
AI Agent Papers2026
Analyzes how to build effective training environment distributions for multimodal agents and proposes Ability-aware Environment Selection (AES) and Hierarchical Difficulty Curriculum (HDC) to improve diversity and difficulty scheduling, yielding large relative gains in experiments.
AI Video Papers2026
Evaluates VLMs' ability to form global spatial awareness from long-horizon egocentric video. Introduces GST-Bench: a VQA benchmark with human-verified questions from 6,790 minutes of synthetic video, reveals a large gap (best zero-shot 42.68 vs human 79.08) and provides GST-Train dataset.
AI Dataset2026
Evaluates schema-guided structured extraction from documents: given a document and a JSON schema, systems must return a schema-valid JSON with page-and-box grounding. Covers 370 documents (4,869 pages) across 8 business domains and 67 document types; scores value accuracy, word/page grounding, and long-list completeness.
Tao Feng, Fangxu Yu +10University of Illinois Urbana-Champaign, University of Maryland, College Park +3
Frames LLM routing as a sequential decision process and introduces LLMRouter plus the xRouteBench benchmark to develop, evaluate, and deploy learned routing policies across heterogeneous LLMs, optimizing response quality versus inference cost.
Yingpeng Ma, Jianhao Yan +7Affiliation: NLP2CT Lab, University of Macau, Macau, China, Affiliation: Westlake University, Hangzhou, China +3
Evaluates whether LLM-driven storyteller agents preserve long-horizon logical consistency under adversarial player interventions. Introduces NCP-Bench (100 movie-derived narrative environments) with structured trajectory/commitments and automatic violation checks; finds strong LLMs often contradict themselves across multi-turn interactions.
AI Model2026
A MoE causal large language model for long-horizon agents, coding, and multi-step reasoning: 2.4T parameters (95B activated), native 262,144-token context (extensible to 1,010,000), multi-token prediction, and configurable thinking-mode reasoning controls.
AI Dataset2026
Human-annotated text dataset that labels perceived “AI slop” with a continuous human slop_score (-1 / 0 / +1) plus provenance metadata (source_dataset, source_row_id, content_hash). Collected via Bench Labs SlopFinder from public datasets for training classifiers and studying subjective perception.