AIAny
Icon for item

Türkçe Atlas — Instruct SFT

Provides 336,146 Turkish instruction-following chat examples (system→user→assistant) for supervised fine-tuning; single train split (no validation/test), reported MIT license, diverse tasks (rewrites, summarization, QA) and a uniform system prompt that may bias model behavior.

Introduction

All 336,146 entries share a conversation-style format (system → user → assistant), making this dataset a large, ready-to-use supply of Turkish instruction-following examples—but that very uniformity is its most important caveat.

What Sets It Apart
  • Single, consistent system prompt across every record: improves intra-dataset consistency and simplifies loss masking for SFT, but increases the risk that a model will overfit to that specific system instruction and underperform under different system prompts.
  • Conversation-native structure: each example stores messages as role-tagged segments rather than paired input/target text, reducing preprocessing work for chat-oriented training pipelines and enabling direct application of chat templates from tokenizers.
  • Broad task coverage with scale: observed examples include rewrites, style transfers, summarization, extractive/abstractive QA, structured JSON/Markdown outputs, NLU-style extraction, numeric reasoning and domain-specific (API, security, health) prompts—useful for building general-purpose Turkish instruction-following assistants.
  • Single train-only split and reported MIT license: simplifies immediate use but requires users to create validation/test splits and to independently verify licensing for downstream redistribution.
Who it's for and trade-offs

Great fit if you need a large, chat-formatted Turkish SFT corpus to bootstrap instruction tuning or LoRA/QLoRA experiments and you plan to (a) apply a chat template-aware tokenizer and (b) implement your own validation split. Look elsewhere if you require inherently diverse system prompts for robust prompt-generalization testing, a curated validation/test set, or guaranteed absence of PII—automated pattern scans found instances resembling emails, phone numbers, national-ID-like strings and URLs, so contextual PII review and masking are recommended before production use.

Practical notes: the dataset is stored as JSONL with a single messages column; many loader examples and tokenizer guidance exist on the hosting page to help map messages into model-specific chat templates. Legal caution: repository metadata reports an MIT license, but the dataset may aggregate external sources—perform a rights review before redistribution or commercial use.

Information

Categories

More Items

Hugging Face

Provides a 1 trillion-token multimodal interleaved dataset (HTML subset updated as data_v1_1 with 742B HTML tokens) and 3.4B images drawn from HTML/PDF/ArXiv sources for multimodal pretraining; released under CC-BY-4.0 with safety and deduplication guidance.

Hugging Face

Provides 369 Harbor sandbox tasks ported from OpenAI's openai/math: each task is a Lean theorem with missing `sorry` proofs that an agent must complete, graded by a strict Comparator exact-match verifier. Includes task definitions, generator, and manifest for RL/code-agent evaluation.

Hugging Face

Curated English Wikipedia text prepared for language-model training and evaluation, provided in WikiText-2 and WikiText-103 variants. Preserves original case, punctuation and numbers; offers raw and tokenized splits for long-range language modeling under a CC BY‑SA license.