AI Dataset2025
Provides MS MARCO queries, passages and answers translated into 14 Indic languages while keeping the original English content and per-example translation metadata. Includes train/validation splits, passage selection flags, and translation model parameters for multilingual IR, QA and RAG research.
AI Dataset2025
1,000,000 US-focused synthetic persona records (6M persona texts) grounded to demographic, geographic and personality distributions. Contains age, sex, education, occupation and ZCTA/city fields; CC BY 4.0 license for LLM training, diversity augmentation, and bias mitigation.
AI Dataset2025
A collection of ready-to-run Hugging Face Jobs OCR scripts that add a markdown column (or structured JSON) to image datasets, with model switching, layout detection, server-mode serving, and per-model options for table/form extraction.
AI Dataset2025
A ~3.2M-conversation Hugging Face dataset of non-toxic human–ChatGPT interactions for instruction finetuning and evaluation; includes full transcripts plus request headers, hashed IP/geolocation, turn-level moderation scores and usage metadata.
AI Dataset2025
A large multi-config collection of query–document pairs assembled to reproduce and extend the mGTE/LateOn data recipe for pre-training text embedding models. Data come in source-specific configs and include per-row drop/duplicate flags and guidance for using cleaned subsets for training.
AI Dataset2025
Benchmark dataset for evaluating agents on long-horizon software-engineering tasks (repo-level patches, test-driven fixes). Includes golden patches, related tests, and problem statements in parquet format; aimed at agent debugging and code-modification evaluation but requires full test environments.
AI Dataset2025
A 1,000,000-sample Vietnamese historical conversation dataset in ShareGPT/ChatML format for question-answering and text-generation. Approximately 78% of samples include step-by-step reasoning chains; remaining samples are final-only. Useful for training or evaluating Vietnamese LLMs and chat agents.
AI Dataset2025
Yuhang Dai, Ziyu Zhang +14Audio, Speech and Language Processing Group (ASLP@NPU), Northwestern Polytechnical University, Beijing AISHELL Technology Co., Ltd. +3
Provides a 10,000-hour Sichuanese (Chuan-Yu) speech corpus with rich annotations (timestamps, speaker age/gender/emotion, SNR, DNSMOS) and unified metadata for ASR and TTS research; includes metadata.jsonl, evaluation benchmarks, and an LLM-assisted transcription pipeline.
AI Dataset2025
Provides a reproducible, deduplicated corpus of text extracted from PDFs for LLM pretraining—about 3 trillion tokens from ~475 million documents in 1733 language-script pairs. Includes OCR and text extraction pipelines, per-page language IDs, MinHash deduplication, and is released under ODC‑By 1.0.
AI Dataset2025
Provides 99,870 system/user/assistant chat triples for defensive cybersecurity instruction‑tuning, with built‑in refusal patterns and mapping to OWASP, MITRE ATT&CK, NIST, and CIS standards; Apache‑2.0 licensed.
AI Dataset2025
Provides a curated collection of hands-on tutorials, workflows and auxiliary files for training and using generative-model tooling (Stable Diffusion, Flux, WAN). Key items include a WAN 2.1 LoRA training tutorial and an articles collection covering DreamBooth, LoRA, LyCORIS and SDXL.
AI Dataset2025
Provides mined hard negatives and relevance scores for 1.88M queries across seven retrieval datasets, enabling contrastive fine-tuning and nv-retrieve filtering; includes full 2048 mined negatives per query, paired query/document splits, and parquet-formatted files for large-scale training.