AIAny
Icon for item

Jagle: Building a Large-Scale Japanese Multimodal Post-Training Dataset for Vision–Language Models

Provides a ~9.2M-instance Japanese multimodal post-training dataset for vision–language models, combining image–text pairs, PDF corpora and generated VQA to improve Japanese VLM performance; access is restricted by Japanese copyright (download via llm-jp GitLab).

Introduction

Jagle addresses a persistent blind spot in multimodal model training: large-scale, high-coverage Japanese post-training data. By assembling roughly 9.2 million instances across images, PDF-derived documents, and synthetic VQA, Jagle supplies the language- and script-specific signal most VLMs lack — and the maintainers report measurable gains on Japanese tasks for models trained with the corpus.

What Sets It Apart
  • Japan-focused scale: ~9.2M multimodal examples specifically curated or translated for Japanese, rather than relying on sparse Japanese subsets of global datasets — this matters because script, cultural context, and annotation styles differ from English-centric corpora.
  • Multiform input types: combines image–text pairs (e.g., WAON, japanese-photos), PDF corpora (FinePDFs-Edu, NDL Warp PDFs) and chart/table datasets (PlotQA, TAT-QA), increasing coverage of real-world VQA and document understanding scenarios.
  • Hybrid VQA generation pipeline: leverages VLM-based QA generation plus translation and filtering to expand question–answer pairs in Japanese, enabling more robust VQA supervision without entirely manual annotation.
  • Empirical impact: training runs reported on a 2.2B model (Qwen3-1.7B + SigLIP2 vision encoder) show notable improvements on Japanese benchmarks after post-training with Jagle.
Who it's for — and tradeoffs

Great fit if you are training or fine-tuning vision–language models that must handle Japanese text, document images, or culturally specific visual context; research teams needing large-scale Japanese VQA and document-reading signals will find the corpus useful. Look elsewhere if you require fully redistributable, globally mirrored data (Jagle is hosted domestically and governed by Article 30-4 of the Japanese Copyright Act), or if your project mandates permissive open licenses for all derived content. Also expect heterogeneous source licenses and attribution requirements because Jagle aggregates many upstream datasets.

Where it fits

Use Jagle as a post-training / continued-pretraining corpus to close the Japanese coverage gap before instruction tuning or downstream fine-tuning for VLM tasks. It complements English-centric multimodal datasets rather than replacing them, and was used to train llm-jp-4-VL models as an example downstream application.

Information

  • Websitehuggingface.co
  • AuthorsIssa Sugiura, Keito Sasagawa, Keisuke Nakao, Koki Maeda, Ziqi Yin, Zhishen Yang, Shuhei Kurita, Yusuke Oda, Ryoko Tokuhisa, Daisuke Kawahara …
  • Published date2026/04/11

Categories

More Items

Hugging Face

Selected ~245B-token corpus of algorithmically relevant code across 11 languages from The Stack v3, produced by file-level language-adaptive selection (UltraData-Code-L2-Classifier). Concentrates problem-solving implementations for LLM code pretraining while preserving broad language coverage; released under ODC-By.

Hugging Face

Contains 73 images used in Hugging Face library documentation, packaged in Parquet and imagefolder formats for examples, demos, and small-scale image experiments; distributed under CC BY‑NC‑SA 4.0.

Hugging Face

A monthly-updated, hive-partitioned parquet corpus of billions of standard rated chess games from Lichess for data analysis and ML — includes move lists with clock info, player Glicko2 ratings, openings, timestamps, and some Stockfish evals under CC0.