Provides compact, agentic text-generation for long-horizon, tool-enabled workflows — trading some peak capability for lower latency and easier on-prem deployment. Key features: adaptive/coherent thinking traces, function-calling support, and sglang/docker-ready serving.
Dynamic interactive benchmark that tests whether LLM agents can adaptively plan and re-plan when world and user constraints are progressively revealed. Built on 307 household tasks with a multi-turn protocol that exposes hidden constraints only after plan violations, emphasizing iterative revision and constraint inference.
Provides a complete, lightly-processed export of AI Village's >1-year multi-agent data: per-agent computer sessions (with screenshots), turn-by-turn computer-use logs, group chats, agent memories, goals, and daily summaries for research into agentic behaviour, multi-agent dynamics, long-horizon memory, and AI safety. Access is manually reviewed.
Measures how coding agents explore repositories by asking them to return a ranked, line-level list of code regions relevant to an issue under a fixed line budget. Covers 848 issues across 203 repos and 10 languages; evaluates coverage, ranking, and context-efficiency to isolate exploration quality.
Provides a virtual, durable filesystem and pluggable execution runtimes for agents running inside Cloudflare Durable Objects. Offers container, isolate-shell, and isolate-JS backends; preview-stage API with ~10GB Durable Object backing and FUSE-mounted container trade-offs.
Code-focused sparse Mixture-of-Experts LLM designed for agentic coding and terminal/tool use, offering very long context (256K) and long outputs. Released with open weights under Apache-2.0 and optimized for transformers/vLLM workflows.
Benchmark for long-horizon computer-use agents that must orchestrate GUI, CLI, and code operations within single trajectories across 114 real-world tasks. Evaluated on a real Ubuntu desktop and paired with a trajectory-aware judge that inspects deliverables, artifacts, and action traces—revealing a top PassRate of ~41.2%.
A benchmark that evaluates interactive spatial reasoning for multimodal agents in realistic tasks. It unifies eight heterogeneous simulators under a simulator-agnostic protocol, provides 760 human-annotated tasks with vision-only partial observability, and uses text-based actions plus terminal-state verification to measure task success.
Guides LLM-based agents to decompose long-horizon research problems and delegate subtasks to constrained subagents, then fine-tunes models on harness-generated trajectories so delegation decisions become internalized. Reports SearchSwarm-30B-A3B achieving top BrowseComp scores for its scale.
Implements MXFP4 quantization on MoE experts plus a BF16 DFlash block-diffusion drafter to propose whole-token blocks for verification, cutting memory bandwidth and backbone forward passes for trillion‑parameter text generation—targeting long‑context, agent and code workloads.
Turns raw datasets into verifiable multimodal news features via a multi-agent newsroom pipeline. Key innovations: (1) an Inspector that links each claim to data/code/external references for re-execution and audit; (2) multimodal asset generation (interactive maps, audio, visuals) tailored to the story.
Lets a single LLM simultaneously act as agent and environment to bootstrap co-evolutional training — using state-prediction process rewards (World-In-Agent) and failure-mode retrieval (Agent-In-World) to reshape training data; reports ~4% average benchmark gain.