Most chart datasets focus on plain plots; infographic charts combine visual motifs, icons and rich textual annotations that break assumptions used by many vision–language models. ChartGalaxy addresses this gap by delivering large-scale, design-aware chart data that ties rendered infographic images to the underlying tables and extracted layout templates, so models can learn both visual design cues and the exact data-to-visual mapping.
What Sets It Apart
- Scale + paired supervision: a multi-million–sample collection of synthetic and real infographic charts where each image is paired with the tabular data that generated it — enabling direct chart↔table supervision for VQA and data extraction tasks, and objective evaluation of code-generation outputs.
- Design-grounded synthesis: templates, chart types, and style variations are induced from real infographic designs and then used in a human-in-the-loop pipeline to create diverse synthetic charts — so the dataset preserves real-world layout diversity while scaling to millions of examples.
- Multi-task utility: includes VQA-style QA pairs, layout templates, chart code benchmarks and example-based generation setups, making it useful for fine-tuning LVLMs, benchmarking chart-to-code systems, and example-driven chart synthesis.
Who It's For and Tradeoffs
Great fit if you want to fine-tune or benchmark multimodal models on infographic-style chart understanding, build chart-to-table extractors, or evaluate chart code generation under real design variability. Look elsewhere if you only need plain plotting libraries or small curated scientific plots — ChartGalaxy emphasizes infographic designs (icons, decorative text, complex layouts). Note practical constraints: the Hugging Face card indicates a non-commercial license for the dataset distribution and real-source images may require observing original copyright terms; synthetic portions are intended for broader reuse but verify license details before commercial use.
