Evaluates how large language models fabricate user attributes in personalization and whether model self-monitoring is a reliable signal. Introduces MirageBench (150 personas, 6 personalization tasks, judge-validated faithfulness taxonomy) and a 12-model leaderboard revealing pervasive over-inference and a 'Self-Monitoring Inversion'.
Systematically studies how language and vision interact during unified multimodal pretraining, identifies mechanisms that enable modality synergy versus competition, demonstrates the benefit of early joint training, and derives efficient pretraining recipes validated at scale.
Tao Feng, Fangxu Yu +10University of Illinois Urbana-Champaign, University of Maryland, College Park +3
Frames LLM routing as a sequential decision process and introduces LLMRouter plus the xRouteBench benchmark to develop, evaluate, and deploy learned routing policies across heterogeneous LLMs, optimizing response quality versus inference cost.
AI Agent Papers2026
Transfers hierarchical, structured memory from a large teacher agent into small LLM agents to improve tool-use success. Constructs Workflow, Subtask and Function memories with proactive/reactive injection; training-free and validated on multiple tool-use benchmarks.
Yingpeng Ma, Jianhao Yan +7Affiliation: NLP2CT Lab, University of Macau, Macau, China, Affiliation: Westlake University, Hangzhou, China +3
Evaluates whether LLM-driven storyteller agents preserve long-horizon logical consistency under adversarial player interventions. Introduces NCP-Bench (100 movie-derived narrative environments) with structured trajectory/commitments and automatic violation checks; finds strong LLMs often contradict themselves across multi-turn interactions.
Describes a 314B-parameter decoder-only Mixture-of-Experts language model that activates 13.2B parameters per token for fine-grained sparsity, long-context (up to 256K) and multi-domain capabilities. Emphasizes GDLA architecture, expert balancing, and multi-teacher distillation.
A research report proposing a continual-learning agent workflow that pairs recursive self-improvement with a Mixture-of-LoRA design: freeze a foundation model, compose specialist LoRA adapters routed per user turn, and support them with long-context RL and post-training infrastructure.
AI Agent Papers2026
Uses a stronger 'builder' model at inference time to construct executable harnesses that boost weaker target models without parameter updates, mainly by turning unstable reasoning into deterministic code, routing, and strict answer-format enforcement.
Separates knowledge storage (a global Memory) from iterative reasoning operators (multiple Reasoners) to improve knowledge compression and inference efficiency; reports a 7B model matching baseline with 62.6% of training data and a 35B Intern-S2-Mobius achieving ~4x end-to-end speedup.
AI Agent Papers2026
Trains compact conversational agents to adapt at runtime to changing 'Harness' configurations (Skills, Hooks, prompts, tools) using Harness-Aware Training (HAT): Harness-State Augmentation, on-policy distillation, and RL to preserve generality while meeting low-latency deployment constraints.
Analyzes how on-policy distillation (OPD) transfers teacher LLM capabilities to student models across in-domain shifts, cross-domain transfer, and multi-teacher settings. Key findings: OPD conveys reasoning patterns rather than specific answers, same-origin teacher-student pairs generalize broadly, and multi-teacher combinations induce mixture-dependent tradeoffs.
Enables interactive serving of large Mixture-of-Experts (MoE) models on personal machines by adapting offload and execution to measured device bandwidth and agentic workload patterns. Key features include bandwidth-adaptive execution, semantic-aware caching of recurrent state, and an elastic GPU expert cache; supports 20+ MoE models and runs models from ~35B to 753B on consumer/workstation GPUs.