AI Agent Papers2026
Evaluates AI agents' ability to complete end-to-end scientific workflows by releasing and assessing 97 tasks from a 300-task FrontierChallenge suite across chemistry, materials, life science, and electrochemistry. Finds that top agent configurations achieved only a 20.6% pass rate despite high partial scores, revealing a gap between partial progress/confident completion claims and actual complete scientific deliverables.
AI Dataset2026
A 10‑billion‑document retrieval benchmark with per‑document 768‑dim unit‑norm dense embeddings and mGTE sparse embeddings, FineWeb text/metadata, and exact top‑1000 MS MARCO ground truth for ~120k queries. Built for large‑scale evaluation of dense/sparse/hybrid retrieval, filtered search, indexing, ANNS algorithms, and embedding compression.
AI Dataset2026
Evaluates retrieval-augmented generation by decomposing user queries into sub-queries and answers into atomic claims, scoring retrieval by query coverage and generation by claim verifiability. Reference-free benchmark with 800 queries, inlined retrieved chunks, and answers from multiple RAG systems; runs locally without API keys.
AI Dataset2026
Contains 244 Cursor agent sessions recorded from Claude Fable‑5, formatted for training and research. Sessions include multi-turn assistant/tool interactions and are Teich-compatible; several rows exceed one million characters, so apply explicit tokenization and oversize policies before training.
AI Dataset2026
Kunal Handa, Miranda Zhang +22Anthropic, Social and Language Technologies (SALT) Lab, Stanford University +2
Provides aggregated, privacy-preserving cluster outputs from three external research teams' analyses of ~250k Claude/Claude Code conversations; includes per-team CSVs (Stanford, Oxford, METR) for studying human–AI collaboration and model behavior without raw conversations.
AI Dataset2026
Provides a unified, camera-conditioned, multi-source video dataset and reproducible processing pipeline for training long-horizon video world models. Key features: a canonical frame-aligned contract (visuals, camera geometry, captions, quality metadata), 1.43M canonical clips with portable releases and reconstruction tools; large download and some backbone assets carry separate licenses.
AI Dataset2026
Synthesizes 234K self-contained, high-difficulty scientific reasoning QA pairs by distilling research papers into compact 'reasoning skeletons'. Emphasizes mechanistic reasoning, hypothesis falsification, quantitative derivation and boundary calibration; built for SFT and reasoning evaluation.
AI Dataset2026
Provides image-level tag correction instructions for a Danbooru anime-image tagging corpus, listing per-post tags to add or remove. Contains 1.74M normalized correction rows (snapshot 2026-08-30); it's a corrections manifest (no images) intended to be applied to existing metadata.
AI Dataset2026
Provides 997 chain-of-thought cybersecurity reasoning records distilled from the Kimi K3 model, each with an explicit <think> trace and a technical resolution or structured tool invocation. Includes verified tool-call objects, diffs, cross-domain coverage, and token-level metadata for fine-tuning and evaluating reasoning models.
AI Dataset2026
A living, crowdsourced dataset of hard-to-translate examples (text, images, audio, video) paired with handcrafted verification rules that flag concrete MT failures. LTBv1 contains 3,456 peer-reviewed examples across many language pairs and accepts ongoing contributions.
AI Dataset2026
Provides ~483K agent instruction‑tuning trajectories for supervised fine‑tuning, including tool calls, environment feedback, errors/retries and verification across search, code, office and general agent workflows; static snapshots for SFT and mix‑ratio studies.
AI Dataset2026
Provides a human-verified benchmark of 1,927 heterogeneous articulated 3D objects with part-level articulation semantics and intrinsic physical-property annotations for evaluating physical grounding and simulation readiness. Includes URDF assemblies, aligned point clouds, per-part JSON annotations, and a curated evaluation protocol; licensed CC BY-NC 4.0 (non-commercial).