Trains a transformer-based graph encoder with RL-guided adaptive masking so retrieved subgraphs embed relationships that better align with frozen LLM text encoders, improving GraphRAG performance with non-parametric retrievers on GraphQA benchmarks.
AI Agent Papers2026
Evaluates how long-term memory in LLM agents amplifies sycophantic behavior and when memory should or should not influence decisions. Provides five targeted tasks, 1,550 standardized samples, an evaluation pipeline, and baseline adapters to test memory use, conflicts, scope, updates, and personalization.
Predicts per-request MoE expert footprints from prefill activations and routes decode requests to workers that maximize expert-locality, lowering decode latency by combining offline K-means partitioning with online locality-band routing and a KV-block–coindexed signature cache.
Compiles natural-language function specifications into compact, locally-executable neural programs (PAW) that run on a small frozen interpreter; a 4B compiler emits LoRA adapters for a 0.6B runtime to provide offline, low-memory fuzzy text functions.
AI Agent Papers2026
Introduces a bounded-memory, typed-retrieval contract for long-horizon LLM agents and evaluates it in Slay the Spire 2 — assembling per-decision prompts from five typed slots rather than appending raw transcripts. Key outputs include ablationable memory layers, 298 labeled trajectories, and reproducible analysis scripts.
AI Video Papers2026
Generates temporally grounded captions for dense multi-event videos by restructuring autoregressive token dependencies to enable lossless parallel decoding; introduces a latent global planning module and event-factorized parallel decoding to improve grounding accuracy and achieve large decoding speedups.
AI Agent Papers2026
Proposes SkillOpt-Lite, a minimal pipeline for optimizing LLM agent skills by treating rollout traces as filesystem files and applying trajectory exploration, consensus mining, and independent validation; integrates as a one-line VSCode Copilot command and reports cross-benchmark improvements that let smaller models sometimes outperform larger ones.
Provides a reusable skill suite for evidence-grounded research ideation: Paper-Search for multi-source literature retrieval, Scoop-Check for prior-art collision checking, and IdeaSpark for pattern-guided idea generation, evidence auditing, and idea-card rendering.
Transfers RL-induced policy shifts from a smaller 'weak' teacher to a stronger target by using the teacher's post-/pre-RL log-ratio as a dense implicit reward applied on the student's on-policy states. Enables reuse of RL supervision without running RL rollouts on the target, improving sample/time efficiency.
Introduces KronQ, a post-training quantization framework that incorporates gradient covariance via a Kronecker‑factored Hessian to guide input/output weight rotations and sensitivity-driven mixed-precision allocation. Demonstrates stable 2-bit weight-only quantization on LLaMA-3-70B (7.93 PPL).
Explores unsupervised visual pretraining on visually rich documents to improve language-model intelligence; shows visual-pretrained models outperform text-only counterparts on the same corpora. Key aspects: direct use of images/layouts (no OCR-only pipeline), scalable across backbones and benchmarks.
Enables RL post-training with million-token prompts under a fixed GPU budget by evaluating shared prompt state without autograd, retaining only minimal model state, and replaying short response branches; instantiated as GRPO and demonstrated on Qwen3.6-27B and GLM-5.2 up to multi-million token execution.