Zhilin Wang, Han Song +14University of Science and Technology of China, The Chinese University of Hong Kong +6
Provides a benchmark and protocol to evaluate agents that iteratively edit executable policies under a fixed interaction budget, recording full execution–feedback–revise trajectories. Built from compact RL environments with trajectory-level diagnostics and hidden held-out validation.
Embodied AI2026
Provides a systematic benchmark and design roadmap for video-based world models to evaluate robot policies, introducing WMBench and GigaWorld-1 optimized for long-horizon, action-faithful rollouts. Offers controlled comparisons across model families, action encodings, and 324k+ simulated vs real rollouts, with code, models, and datasets released for reproducible evaluation.
AI Agent Papers2026
Introduces a bounded-memory, typed-retrieval contract for long-horizon LLM agents and evaluates it in Slay the Spire 2 — assembling per-decision prompts from five typed slots rather than appending raw transcripts. Key outputs include ablationable memory layers, 298 labeled trajectories, and reproducible analysis scripts.
AI Agent Papers2026
Provides a comprehensive benchmark to evaluate LLM-based data agents on realistic, multi-domain data-science workflows. Features skill-level ground-truth labels, 15 vertical domains (including real B2B tasks), and LLM-driven task generation to ensure coverage; includes an open testbed and agent evaluations.
AI Agent Papers2026
Proposes SkillOpt-Lite, a minimal pipeline for optimizing LLM agent skills by treating rollout traces as filesystem files and applying trajectory exploration, consensus mining, and independent validation; integrates as a one-line VSCode Copilot command and reports cross-benchmark improvements that let smaller models sometimes outperform larger ones.
AI Dataset2026
Converts long or messy model reasoning traces into concise, user-facing summaries with optional metadata. 61K cleaned English samples in JSON format, Apache-2.0 licensed, created to train and evaluate reasoning-summarization models and to present safe, readable explanations instead of raw chain-of-thought.
Embodied AI2026
Evaluates generalist robot manipulation policies across simulation and real-world settings using 42 sim tasks and 18 real tasks; measures generalization, memory, precision, long-horizon execution and open-vocabulary instruction following, and provides a cloud-accessible real-world evaluation system with XPolicyLab integration and a public leaderboard.
Provides a reusable skill suite for evidence-grounded research ideation: Paper-Search for multi-source literature retrieval, Scoop-Check for prior-art collision checking, and IdeaSpark for pattern-guided idea generation, evidence auditing, and idea-card rendering.
AI Model2026
Fine-tuned variant of Qwen3.6-27B that cuts internal reasoning (‘thinking’) token usage by roughly 46% on average while preserving benchmark accuracy and safety behavior. Targets lower latency and inference cost; ships on Hugging Face with GGUF quantizations for local use.
Transfers RL-induced policy shifts from a smaller 'weak' teacher to a stronger target by using the teacher's post-/pre-RL log-ratio as a dense implicit reward applied on the student's on-policy states. Enables reuse of RL supervision without running RL rollouts on the target, improving sample/time efficiency.
Performs native structural reasoning for proteins, small molecules and inorganic crystals by tokenizing coordinates, topologies and periodic connectivities into a unified structure-aware vocabulary. Treats structural tokens as addressable evidence to produce interpretable prediction traces and improves accuracy across biology, chemistry and materials benchmarks.
Provides IdeaGene-Bench, a dataset and evaluation suite for scientific-lineage reasoning and lineage-grounded idea generation, representing papers as minimal, typed Idea Genome objects and GenomeDiffs that record inheritance, mutation, loss, import and novel insertion. Includes 1,961 lineage traces, IG-Exam (42 task types) and IG-Arena with a Population-Evolution Score for generation.