Training dataset for byte-level language identification across 334 languages with ~2.48M paragraph samples (primarily Wikipedia and open-licensed corpora). Curated to reduce multilingual contamination, boost low-resource coverage, target frequent confusions, and preserve per-row license metadata for attribution.
Parallel Khasi–English sentence pairs for machine translation research focused on low-resource NLP in Northeast India. Provided as a small CSV (sentence_id, english_text, khasi_text) under CC BY‑NC 4.0 for non-commercial research use.
Curated monolingual Khasi sentence corpus (CSV) with under 1,000 sentences for language modeling, tokenization, and low-resource NLP experiments. Single-column structure (khasi_sentence) and CC BY‑NC 4.0 license — suitable for research and data-augmentation workflows, not for commercial use.
Contains ~1,973 distilled roleplay conversations with character-perspective chain-of-thought traces (<think> blocks) for fine-tuning persona-focused chat models. Includes teacher provenance, safety/review flags, and filters for NSFW/borderline samples — suited for SFT and character retention tests.
Provides 1.3 billion platform-specific video URLs extracted from CommonCrawl along with crawl metadata (no media included), serving as the source corpus for the LAION-BVD multimodal video dataset; distributed on Hugging Face in Parquet format.
A Chinese public-transit route-planning dataset for training and benchmarking LLMs that generate structured transit routes from origin–destination pairs. Releases include a large CPT corpus, SFT train/test splits, and a 30K real-world benchmark; anonymized and real testsets are provided for privacy-aware, fair evaluation.
Provides 19,331 multi-turn ChatML Hermes reasoning traces produced by DeepSeek V4 Pro for LoRA fine-tuning of agent-style models; includes VRAM-tiered variants, train/valid/test splits, and dense tool-calling annotations in Parquet format.
Provides 19,331 multi-turn ChatML Hermes reasoning traces for LoRA fine-tuning of local models to behave as Hermes agents. Includes train/valid/test splits, VRAM-tiered variants (nano→spark), ~138K tool-call annotations, and Parquet format under Apache-2.0.
Agentic coding evaluation dataset containing real-world, multi-step developer tasks and raw model responses across 20+ programming languages. Emphasizes challenging, persona-driven prompts for benchmarking and fine-tuning; users should filter and audit outputs before training.
A retrieval benchmark suite focused on “oblique queries,” where relevance depends on latent attributes rather than surface keywords. Includes five tasks with large corpora, qrels (and pooled judgments), and task-specific constraints for evaluating embedding-based retrievers and reasoning-augmented retrieval.
Provides JSON traces from a Codex-driven swebenchpro agentic benchmark, including per-call token counts, cache hit rates, timing, and per-trial outcomes. Useful for research into LLM caching, long-context workloads, and agent evaluation. MIT-licensed and compact.
Provides task-card metadata for 147 long-horizon professional tasks from the Agents Last Exam benchmark — titles, prompts, taxonomy, and input-file descriptors. This v1.0 release is metadata-only; companion repos host input files and gated reference outputs.