AI Dataset2022
Curated English Wikipedia text prepared for language-model training and evaluation, provided in WikiText-2 and WikiText-103 variants. Preserves original case, punctuation and numbers; offers raw and tokenized splits for long-range language modeling under a CC BY‑SA license.
AI Dataset2023
A public dataset of one million real-world conversations with 25 LLMs, including conversation text, model name, detected language tags, and OpenAI moderation outputs — useful for studying prompt distributions, safety/moderation, and training/evaluating instruction-following models.
AI Dataset2024
Provides a 1 trillion-token multimodal interleaved dataset (HTML subset updated as data_v1_1 with 742B HTML tokens) and 3.4B images drawn from HTML/PDF/ArXiv sources for multimodal pretraining; released under CC-BY-4.0 with safety and deduplication guidance.
AI Dataset2024
A monthly-updated, hive-partitioned parquet corpus of billions of standard rated chess games from Lichess for data analysis and ML — includes move lists with clock info, player Glicko2 ratings, openings, timestamps, and some Stockfish evals under CC0.
AI Dataset2024
A fine-grained, domain-labeled web corpus for NLP and LLM research that decomposes a deduplicated web crawl into 67 domains via iterative URL/content labeling and coarse→fine recall; includes per-domain statistics, validation subsets, and domain-benchmark analysis tools.
AI Dataset2025
Synthetic English-language dataset of 100k+ B2B SaaS sales conversations with turn-by-turn conversion outcomes, engagement and sales-effectiveness metrics, and 3072-dim embeddings for training conversion-prediction and RL-based conversation models.
AI Dataset2025
Mohammad Javad Ranjbar Kalahroodi, Heshaam Faili +1University of Tehran, Institute for Research in Fundamental Sciences (IPM)
Provides a large-scale, multi-speaker Persian speech–text corpus constructed from audiobooks for TTS, ASR, and speaker research. Includes automated alignment and quality scoring, TTS-ready subsets (thousands of hours/1M+ segments) and metadata for speaker IDs and genders — suitable for multi-speaker synthesis and voice cloning research.
AI Dataset2025
Open synthetic corpus for training small reasoning-focused language models — ~79.65M generated samples (≈75B tokens with Pleias tokenizer) amplified from ~58.7k Wikipedia/Wikibooks seeds; includes explicit synthetic reasoning traces, multilingual coverage, and parquet splits.
AI Dataset2026
Provides a sanitized, labeled SOC capture and merged provenance graph for intrusion-detection research, including 2,011,674 live signals, 51,371 incident graphs, MITRE ATT&CK mappings, and deterministic attack reports.
AI Dataset2026
De-identified longitudinal multimodal CT dataset for multicancer screening that pairs ~24k CT volumes with radiology reports and voxel-wise tumor annotations across 13 cancer types. Designed for longitudinal disease modeling, detection/segmentation and vision–language research; CC BY‑NC‑ND 4.0 for non-commercial use.
AI Dataset2026
Provides 1,800+ hours of synchronized egocentric multi-view recordings with 3D hand reconstructions, wide‑FOV depth, and hierarchical task/subtask annotations for embodied AI and robot learning. Includes six fisheye views, hand meshes, and per-episode temporal labels across 44k+ episodes.
AI Dataset2026
Provides 30,969 action-conditioned video episodes, each with source MP4, per-frame keyboard control logs, captions, and a COLMAP sparse pose model — intended for research on action-conditioned video prediction, controllable world models, and representation learning.