AIAny
Icon for item

AnswerCarefully

Provides manually curated Japanese instruction pairs (questions and safe reference answers) for improving LLM output safety, covering broad harm categories and regionally sensitive cases. Includes English meta-tags and standard splits for benchmarking and fine-tuning.

Introduction

Why this matters Many safety datasets are templatic or generated; AnswerCarefully instead collects realistic, manually written Japanese prompts paired with safe reference replies so models learn culturally appropriate refusal, de-escalation, and safe guidance. That makes it practical for both fine-tuning and evaluating models used by Japanese speakers.

What Sets It Apart
  • Manual, culturally grounded samples: every question–answer pair was authored or curated by human annotators to reflect Japanese social and linguistic nuances, reducing unnatural or unrepresentative examples common in synthetic datasets.
  • Broad, taxonomy-driven coverage: built on the Do-Not-Answer safety taxonomy, it spans many harm categories (e.g., illegal instruction, medical/suicide advice, hate, privacy) and adds regionally sensitive items specific to Japan.
  • Usable as instruction data and benchmark: includes reference answers intended for supervised fine-tuning and separate dev/test splits (v1/v2/v3 details), plus English meta-tags in newer releases to aid cross-language adaptation.
Who It's For and Trade-offs

Great fit if you need a compact, safety-focused instruction dataset to reduce harmful outputs from Japanese LLMs or to benchmark safety behaviors across models. It’s especially useful for teams fine-tuning models for Japan-specific deployments. Look elsewhere if you need very large-scale safety corpora, exhaustive multilingual coverage beyond Japanese/English meta-tags, or raw conversational logs — AnswerCarefully prioritizes curated safety cases over scale.

Where It Fits

Serves as a mid-sized, high-quality safety dataset for LLM fine-tuning and evaluation, complementary to larger synthetic or web-mined safety corpora. Works well alongside general-purpose instruction data when the goal is safer, culturally aligned responses for Japanese users.

Information

  • Websitehuggingface.co
  • OrganizationsLLM-jp (Center for Large Language Model Research and Development, National Institute of Informatics), National Institute of Informatics
  • AuthorsHisami Suzuki, Satoru Katsumata, Takashi Kodama, Tetsuro Takahashi, Kouta Nakayama, Satoshi Sekine
  • Published date2024/04/30

Categories

More Items

Hugging Face

Selected ~245B-token corpus of algorithmically relevant code across 11 languages from The Stack v3, produced by file-level language-adaptive selection (UltraData-Code-L2-Classifier). Concentrates problem-solving implementations for LLM code pretraining while preserving broad language coverage; released under ODC-By.

Hugging Face

Contains 73 images used in Hugging Face library documentation, packaged in Parquet and imagefolder formats for examples, demos, and small-scale image experiments; distributed under CC BY‑NC‑SA 4.0.

Hugging Face

A monthly-updated, hive-partitioned parquet corpus of billions of standard rated chess games from Lichess for data analysis and ML — includes move lists with clock info, player Glicko2 ratings, openings, timestamps, and some Stockfish evals under CC0.