AI Dataset2026
Benchmark for joint speaker diarization and speaker-attributed ASR across all 22 scheduled Indian languages, providing ~108 hours of human-corrected, time-aligned, speaker-attributed transcripts. Includes near-field, far-field and in-the-wild recordings with code-mixing and speaker overlap.
AI Dataset2026
A compact dataset of prompt templates and examples designed to teach LLMs to consistently report model identity fields (model ID, name, creator, family, architecture, parameter count, knowledge cutoff). Includes regex markers, usage guidance, example replacements, and a small personalization script for fine‑tuning or runtime substitution.
AI Dataset2026
Provides 30,969 action-conditioned video episodes, each with source MP4, per-frame keyboard control logs, captions, and a COLMAP sparse pose model — intended for research on action-conditioned video prediction, controllable world models, and representation learning.
AI Dataset2026
Evaluates schema-guided structured extraction from documents: given a document and a JSON schema, systems must return a schema-valid JSON with page-and-box grounding. Covers 370 documents (4,869 pages) across 8 business domains and 67 document types; scores value accuracy, word/page grounding, and long-list completeness.
AI Dataset2026
Provides raw, unscripted first-person household video footage for training vision and embodied AI models. Released incrementally on Hugging Face in WebDataset shards with metadata parquets under Apache‑2.0; current raw tier contains ~7,834 hours (≈397k videos).
AI Dataset2026
Provides OCR full text for 11.55M public-domain German newspaper pages (1638–1964) with per-page IIIF scans and ALTO XML coordinates; suited for historical NLP, language-model training, and OCR research. Pages carry explicit per-page public-domain licenses.
AI Dataset2026
Provides a machine-readable catalog of 117 AI/AX safety and deployment-readiness diagnostic criteria for assessing model intrinsic and serving/infrastructure risks. Includes MODEL-SCAN and AX-SCAN axes, bilingual source fields, per-item evidence guidance, severity/assurance metadata, and a CC BY-NC 4.0 release-candidate.
AI Dataset2026
A synthetic, verifiable-first agentic training corpus with 19,072 training traces and 2,135 held-out evaluation rows. Provides per-turn visible reasoning, real sandboxed tool executions, 13 verifiable task families, and NeMo Gym / RL-ready reward contracts for SFT and RL workflows.
AI Dataset2026
Provides multiple Parquet-backed subsets of code problem-solving data (direct answers, chain-of-thought reasoning, and task synthesis) that are streamable and prepared for language-model training and evaluation.
AI Dataset2026
10,005 single-turn prompts and metadata derived from Ox Alpha chat traces, labeled by category, subcategory, and difficulty. Built for response-teacher generation and distillation workflows, with topic and difficulty distributions to aid dataset curation.
AI Dataset2026
Evaluates retrieval-augmented generation by decomposing user queries into sub-queries and answers into atomic claims, scoring retrieval by query coverage and generation by claim verifiability. Reference-free benchmark with 800 queries, inlined retrieved chunks, and answers from multiple RAG systems; runs locally without API keys.
AI Dataset2026
Kunal Handa, Miranda Zhang +22Anthropic, Social and Language Technologies (SALT) Lab, Stanford University +2
Provides aggregated, privacy-preserving cluster outputs from three external research teams' analyses of ~250k Claude/Claude Code conversations; includes per-team CSVs (Stanford, Oxford, METR) for studying human–AI collaboration and model behavior without raw conversations.