Provides 2 million synthetic, expert-verified coding examples with step-by-step reasoning and executable solutions for fine-tuning instruction-following and code-generation models. Curated through multi-stage filtering and automated test validation to prioritize correctness and reasoning.
Collects ~200,000 human responses to 20 visual/semantic association questions (e.g., Bouba–Kiki), with per-response image options and demographic metadata — useful for cross‑cultural perception and evaluation of multimodal systems, but not guaranteed as a rigorously controlled experimental sample.
Large-scale, real-world dual-arm video corpus for embodied robotics and reinforcement-learning research — over 1TB of multimodal recordings on Hugging Face, intended for training and evaluating agents in real manipulation scenarios; CC BY‑SA 4.0.
Provides open ASR and TTS speech data for 24 Sub‑Saharan African languages to train and evaluate speech models. Includes ~1,250 hours of transcribed ASR and ~235 hours of single‑speaker TTS with train/validation/test/unlabeled splits and mixed CC-BY licenses.
Large-scale mathematical reasoning dataset of model-generated solution trajectories produced with and without Python Tool-Integrated Reasoning (TIR), with final answers verified against reference solutions. Contains ~3.64M JSONL training samples (~144 GB) and per-source CC-BY / CC-BY-SA licensing; intended for training and evaluating tool-augmented mathematical reasoning in LLMs.
Processed, multilingual news corpus of 1.357B articles extracted from Common Crawl CC‑News with per-article WARC provenance. Includes trafilatura-extracted bodies, language labels (GlotLID & CommonLingua), IPTC topic tags, monthly Parquet shards and a companion FM-index for sub-10ms substring queries; bulk text access is gated for academic research.
Provides 100 real-world, open-ended research tasks paired with expert-written rubrics (around 40 weighted criteria per task) to evaluate long-form, web-browsing research agents on factual accuracy, analysis depth, presentation, and citation quality.
Provides L3 refined synthetic training data by converting high-quality web corpora into Q&A pairs and multi-style rewrites; supplies 400B+ English and 200B+ Chinese tokens for late-stage LLM pretraining and decay-phase training.
Provides multi-task long-speech evaluation data for eight speech-understanding tasks (ASR, summarization, QA, translation, emotion, speaker counting, content separation, language detection). Includes 101,822 long audio files and ~204,881 annotated examples with JSONL task splits for easy loading.
Filtered subset of the OPUS 4.6 parallel corpus that isolates reasoning-related translation examples and removes 979 refusals, providing a cleaner 3,000×-filtered dataset for training or evaluating NLP models focused on reasoning in translation.
Cleaned reasoning dataset of problem→thinking→solution triplets derived from Opus 4.6, provided in Parquet with ~2,160 cleaned rows (original 3,305). Filters remove empty/short/refusal/non‑substantive responses; hosted on Hugging Face under Apache‑2.0.
Provides 1.06M web interaction trajectories (state, action, next_state) represented primarily as A11y trees for training browser world models and web agents. Covers diverse real‑web domains, English/Chinese pages, and long contexts (up to 30K tokens); residual PII and dynamic content may limit reproducibility.