AI Dataset2025
Provides MS MARCO queries, passages and answers translated into 14 Indic languages while keeping the original English content and per-example translation metadata. Includes train/validation splits, passage selection flags, and translation model parameters for multilingual IR, QA and RAG research.
AI Dataset2025
Open synthetic corpus for training small reasoning-focused language models — ~79.65M generated samples (≈75B tokens with Pleias tokenizer) amplified from ~58.7k Wikipedia/Wikibooks seeds; includes explicit synthetic reasoning traces, multilingual coverage, and parquet splits.
AI Dataset2025
Collects ~200,000 human responses to 20 visual/semantic association questions (e.g., Bouba–Kiki), with per-response image options and demographic metadata — useful for cross‑cultural perception and evaluation of multimodal systems, but not guaranteed as a rigorously controlled experimental sample.
AI Dataset2026
Provides 100 real-world, open-ended research tasks paired with expert-written rubrics (around 40 weighted criteria per task) to evaluate long-form, web-browsing research agents on factual accuracy, analysis depth, presentation, and citation quality.
AI Dataset2026
Provides 6,000 runnable, operator-level PyTorch tasks for training and evaluating CUDA kernel generation models; each sample includes executable code, operator descriptors, and provenance tags, with execution-driven filtering to ensure reproducibility and contamination control.
AI Dataset2026
Provides 3,000+ hours (≈611K utterances) of transcribed 16 kHz multi-dialect Arabic speech across 13 dialects for ASR and spoken-dialect identification. Transcripts preserve dialectal orthography (partial diacritics); the train split is ~337 GB in parquet, so streaming is recommended.
AI Dataset2026
Provides 336,146 Turkish instruction-following chat examples (system→user→assistant) for supervised fine-tuning; single train split (no validation/test), reported MIT license, diverse tasks (rewrites, summarization, QA) and a uniform system prompt that may bias model behavior.
AI Dataset2026
Provides 207k+ LLM-generated agent trajectories of code edits and tool interactions for training and evaluating software-engineering agents. Collected via OpenHands and SWE-agent using Qwen3.5-122B and MiniMax-M2.5, multilingual across nine languages and released under CC BY 4.0.
AI Dataset2026
Provides 150,000 synthetic Vietnamese patient personas to condition clinical text generation. Each persona bundles demographics, socioeconomic context, health and behavior fields, and prompt-ready narratives; intended for research and simulation, not clinical decision-making.
AI Dataset2026
Provides 545,431 math problems with model-generated solution traces (chain-of-thought and Python tool-integrated reasoning) verified against reference answers for training and evaluating LLM mathematical reasoning. Parquet-format dataset; DeepSeek‑V4‑Pro generated traces and mixed CC BY / CC BY‑SA licensing.
AI Dataset2026
Provides 1.3 billion platform-specific video URLs extracted from CommonCrawl along with crawl metadata (no media included), serving as the source corpus for the LAION-BVD multimodal video dataset; distributed on Hugging Face in Parquet format.
AI Dataset2026
Provides a county-harmonized corpus of U.S. municipal and county ordinance text (≈2.21M chunks) labeled for function, substantive indicator, and topic to support legal NLP, retrieval, and comparative local-law research. Includes model-assigned labels and continuous scorers (opacity, paternalism, enforcement discretion) plus coverage metadata; not exhaustive or a substitute for legal advice.