Experimental open-weight multimodal LLM preview designed for long-context, agentic workloads. It introduces hybrid sparse attention (QSA), gated residual streams, and large offloadable n‑gram embeddings (51B) alongside a high-sparsity MoE (125B total, 6B active) to trade memory for runtime efficiency and improved long-horizon reasoning.
Assesses mobile planning agents' ability to call tools, plan long-horizon workflows, and coordinate sub-agents in realistic, interactive phone scenarios via a stateful executable sandbox. Covers 13 domains, 212 tools, evidence-based verification, and tests memory, skill usage, permission and runtime constraints.
Automatically optimizes runtime harnesses for LLM agents by diagnosing failure traces and iteratively applying structured, generalizable patches. Combines batch-based failure diagnosis, code-like patch generation across prompts/tools/middleware, and validation-aware selection to raise long-horizon task success on multiple benchmarks.
Develops methods to scale agentic AI for sustained, verifiable execution of complex long-horizon work by expanding executable environments and training coordinated agents with a shared execution harness (AgentOS) to maintain state, provenance, and failure recovery.
Provides 1.21M densely annotated desktop screenshots and 159.7M element instances for training and evaluating GUI grounding and screen-parsing models. Includes per-element accessibility-derived annotations, 917K recorded click transitions, multi-application scenes across seven appearance presets and resolutions; distributed as WebDataset shards with Parquet indexes.
Evaluates AI agents' ability to complete end-to-end scientific workflows by releasing and assessing 97 tasks from a 300-task FrontierChallenge suite across chemistry, materials, life science, and electrochemistry. Finds that top agent configurations achieved only a 20.6% pass rate despite high partial scores, revealing a gap between partial progress/confident completion claims and actual complete scientific deliverables.
Proposes Recuris, a recursive Experiential-Working Memory architecture that separates Working Memory (task progress) from Experiential Memory (skills) and uses a Meta-Agent to validation-gate localized skill updates, enabling bounded recursive skill evolution for long-horizon agents.
Proposes treating game development as a recursive data engine and introduces RLHEV (Reinforcement Learning with Human-Engine Verification) to combine dense engine checks (collision, physics, navigability) with human acceptance feedback, producing trajectory data and rewards for post-training world models.
Provides a streaming dual-brain memory for real-time speech agents: an informational left brain for factual retrieval and an affective right brain for persona/emotion, achieving high top-5 accuracy while keeping retrieval latency within VAD budgets (~134 ms).
Synthesizes, repairs, and self-evolves task-adaptive agent harnesses on demand for off-the-shelf LLM agents, using a trainable harness-intelligence model that distills signals from past configurations. Demonstrates consistent performance gains across benchmarks and model families by producing four-module, composable harnesses.
Analyzes how to generate useful interaction data for LLM agents and proposes the ACE lens — Accuracy, Complexity, divErsity — while factorizing agentic data as (E, q, τ, v). Surveys verification, difficulty calibration, and coverage strategies and outlines implications for training and benchmarks.
Decides when past post-training updates should be reused for autonomous LLM adaptation by introducing Boundary-Calibrated Intervention Transfer (BCIT). BCIT binds effects to source context, checks applicability and hard conflicts, and runs bounded trials to obtain current-state evidence—reducing harmful updates and improving equal-budget final-model quality.