AIAny
Icon for item

Nemotron-Personas-Korea

Synthetic Korean-language persona dataset for training and evaluating conversational and generative models — 1M records (≈7M persona entries) with 26 fields aligned to South Korea’s demographic distributions. Built with NeMo Data Designer and released under CC BY 4.0.

Introduction

Nemotron-Personas-Korea matters because region-specific demographic fidelity changes model behaviour: models trained on locally representative personas produce more culturally grounded responses and help reveal demographic blind spots. This dataset provides a large, structured, and openly licensed Korean persona resource aimed at improving diversity and reducing bias in Korean-language model training.

What Sets It Apart
  • Demographic grounding: records are synthesized to match official Korean distributions (age, province, education, occupation), so conditioning on realistic population slices is possible — useful when you need training data that reflects local prevalence rather than global averages.
  • Scale and granularity: 1M records with ~7M persona entries across 26 fields (names, region, education, multiple persona types), enabling fine-grained conditioning and sampling strategies for data augmentation and evaluation.
  • Reproducible synthetic pipeline: generated with NeMo Data Designer using a probabilistic graphical model and open components, which facilitates integration into synthetic-data workflows and iteration for sovereign-AI development.
  • Open license and tooling: CC BY 4.0 license and Hugging Face distribution make it easy to inspect, cite, and reuse for both research and commercial projects.
Who Should Use It — and When To Look Elsewhere

Great fit if you are training or evaluating Korean conversational agents, building region-aware prompting/conditioning strategies, or augmenting scarce local data to reduce bias. It’s also useful for benchmarking persona-conditioned generation and for teams building sovereign-AI systems that require region-specific synthetic data. Look elsewhere if you need verified real-person records, clinical/financial records, non-adult personas (dataset includes only adults 19+), comprehensive gender statistics distinct from biological sex, or if your use case requires modeling complex interactions between variables (the generation process applies independence assumptions between some factors).

Method & Ethical Notes

The dataset was generated using NeMo Data Designer’s hybrid pipeline (probabilistic graphical modeling + language-model components) and seeded with public Korean statistics. All entries are synthetic; any similarity to real individuals is coincidental. The maintainers note limitations: certain cross-factor interactions were simplified, and gender identity beyond binary biological sex is not represented due to public-data availability. Users should evaluate downstream privacy, fairness, and domain-suitability before deployment.

Information

Categories

More Items

Hugging Face

A collection of ready-to-run Hugging Face Jobs OCR scripts that add a markdown column (or structured JSON) to image datasets, with model switching, layout detection, server-mode serving, and per-model options for table/form extraction.

Hugging Face

Provides 115M public GitHub source files (≈873GB of code, ~1TB uncompressed) with per-file metadata (repo, path, language, license). Supports streaming, language/license filtering and full download for training and evaluating code LLMs and code generation models.

Hugging Face

Provides labeled prompts with full-reference answers (including chain-of-thought and code blocks) and per-example metadata to train edge routing/orchestrator models that decide whether to handle inputs locally or route them to larger models. Includes complexity scores, coding/math flags, routing justifications, and an automated override rule; suited for fine-tuning small models (50M–1.5B) for edge deployment.