AI Dataset2024
Provides point-accurate annotations of interactive parts in high-resolution indoor laser-scan point clouds, plus affordance labels, motion axes and natural-language task descriptions; includes aligned iPad RGB-D video slices with 2D projections for multimodal research.
AI Dataset2024
A mixed instruction dataset for SFT and RLHF research that combines chat, math, code and instruction-following samples from multiple public datasets under an Apache-2.0-compatible license; intended for instruction tuning and evaluation.
AI Dataset2025
Multi‑modal closed-ended academic benchmark with 2,500 multiple-choice and short-answer exam questions spanning math, natural sciences, and humanities for automated grading. Curated by subject-matter experts, released under MIT, and includes a canary string to help prevent dataset leakage into model training.
AI Dataset2025
A curated dataset of ~30,000 CUDA kernels generated by an agentic pipeline, including reference PyTorch implementations, runtime metrics, NCU/Torch/Clang-Tidy profiles, error messages and correctness labels — released under CC-BY-4.0 for model fine-tuning and offline RL/optimization research.
AI Dataset2025
Provides professionally translated parallel corpora and a multilingual lexicon across 100+ low-resource languages for training and evaluating multilingual MT and NLP models. Includes SmolDoc, SmolSent, GATITOS, and factuality annotations; licensed CC-BY-4.0.
AI Dataset2025
A benchmark dataset for evaluating MLLM-driven interactive webpage code generation: provides prototyping screenshots, action.json interaction metadata, and example generation scripts across 127 webpages and 374 interactions to test dynamic UI-to-code capabilities.
AI Dataset2025
High-quality, efficiently verified and filtered web corpus for LLM pretraining — supplies ~1 trillion English tokens and ~120 billion Chinese tokens with English/Chinese Parquet splits. Designed for large-scale pretraining experiments and data-filtering research.
AI Dataset2025
Jake Poznanski, Jon Borchardt +7Allen Institute for Artificial Intelligence (AI2), AllenNLP / olmOCR team
Benchmark for evaluating OCR systems that convert PDFs and scans into Markdown and structured text: 1,403 PDFs and 7,010 unit tests covering text presence/absence, reading order, tables, and math formula accuracy. Diverse sources and ODC-BY-1.0 license for research use.
AI Dataset2025
Provides 5 million instruction–response pairs for supervised fine-tuning of code LLMs, with inputs, outputs, unit tests, and automated LLM judgments. Uses hybrid automated/synthetic generation and is released under CC BY 4.0 for large-scale SFT workflows.
AI Dataset2025
Pan-cancer CT segmentation dataset for training and benchmarking medical-image segmentation models — packaged as a Hugging Face dataset with an estimated 10k–100k samples and linked arXiv references. Designed for model development and reproducible benchmarking; non-commercial license applies.
AI Dataset2025
A human-verified subset of 500 SWE-bench test cases for evaluating models that resolve GitHub issues into PRs using unit-test verification. Contains problem statements and base commits (pre-fix) for reproducible unit-test based evaluation; suitable for benchmarking code-fix and issue-resolution capabilities.
AI Dataset2025
Provides 1.7M+ synthetic and real infographic charts paired with their tabular data for training and evaluating multimodal models on infographic understanding, chart-to-table extraction, chart code generation, and example-based chart synthesis.