AI Dataset2026
Kunal Handa, Miranda Zhang +22Anthropic, Social and Language Technologies (SALT) Lab, Stanford University +2
Provides aggregated, privacy-preserving cluster outputs from three external research teams' analyses of ~250k Claude/Claude Code conversations; includes per-team CSVs (Stanford, Oxford, METR) for studying human–AI collaboration and model behavior without raw conversations.
AI Dataset2026
Provides image-level tag correction instructions for a Danbooru anime-image tagging corpus, listing per-post tags to add or remove. Contains 1.74M normalized correction rows (snapshot 2026-08-30); it's a corrections manifest (no images) intended to be applied to existing metadata.
AI Dataset2026
Provides 997 chain-of-thought cybersecurity reasoning records distilled from the Kimi K3 model, each with an explicit <think> trace and a technical resolution or structured tool invocation. Includes verified tool-call objects, diffs, cross-domain coverage, and token-level metadata for fine-tuning and evaluating reasoning models.
AI Dataset2026
A living, crowdsourced dataset of hard-to-translate examples (text, images, audio, video) paired with handcrafted verification rules that flag concrete MT failures. LTBv1 contains 3,456 peer-reviewed examples across many language pairs and accepts ongoing contributions.
AI Dataset2026
Provides 23,625 semi-structured smart-contract audit findings (title, description, PoC, recommendation, normalized severity) for defensive-security research; requires cleaning, deduplication, and PoC filtering before model training.
AI Dataset2026
Provides 315,000 pairwise human-preference votes comparing 15 English TTS models over 300 operational prompts, with 4,500 high‑quality audio renders and structured vote/pair/prompt records for training or evaluating preference/reward models. Metadata under CC-BY-4.0; audio use governed by model providers' terms.
AI Dataset2026
Provides 4.5 billion TikTok video records with captions, timestamps, music IDs and engagement counts for research; split across 27 zstd-compressed Parquet files (~289 GB) and sampled via TikTok's mobile API; released for research-use only with privacy and ToS caveats.
AI Dataset2026
Provides layered code pretraining corpora (L2 ~400B tokens, L3 ~150B tokens) across 11 languages by filtering ~192M public GitHub repositories into standardized files, algorithmically relevant selections, and implementation-grounded programming exercises. Includes per-file metadata (role, algo relevance, quality) and serialized task records; released under Apache-2.0.
AI Dataset2026
Provides a bilingual Chinese–English corpus for LLM training covering pretraining, capability-oriented midtraining (16K–256K long contexts), and supervised fine-tuning. Includes ~4.2T pretrain tokens, ~600B midtrain tokens, and ~4.57M SFT samples; sources span web, PDFs/OCR, code, math, QA, and agentic trajectories under mixed upstream licenses.
AI Dataset2026
Selected ~245B-token corpus of algorithmically relevant code across 11 languages from The Stack v3, produced by file-level language-adaptive selection (UltraData-Code-L2-Classifier). Concentrates problem-solving implementations for LLM code pretraining while preserving broad language coverage; released under ODC-By.
AI Dataset2026
Benchmark for typed probabilistic decisions: given one shared state, a model answers multiple typed questions at once and returns full probability distributions (noul/choice/score). Contains four workflows with train/test splits and soft gold labels from teacher samples, designed to evaluate accuracy, calibration, and latency trade-offs.
AI Dataset2026
Provides a complete benchmark and training release for native audio‑visual dialogue: 2,800 synthesized audio‑visual dialogues, tiered rubrics, scoring code, ~28GB of 1080p media, and an RL reward recipe to evaluate and train omni models that take video+audio and return text.