AIAny
Icon for item

GGT-100K: Generative Ground Truth for Generalizable Real-World Image Restoration

Synthesizes high-quality targets for real-world image restoration by using multimodal foundation models (MFMs) to convert real low-quality photos into HQ references. Provides GGT-100K (103,707 LQ–HQ training pairs + 500 test pairs) with multi-stage quality control and demonstrates consistent generalization gains for a range of restoration models, especially for finetuning generative restorers.

Introduction

Most real-world image restoration is bottlenecked by the scarcity of reliable paired LQ–HQ data; synthetic datasets fail to capture complex degradations, while capturing real pairs is costly. This work's core insight is to treat powerful multimodal foundation models as generators of high-quality ground truth (GGT): synthesize perceptually realistic, content-faithful HQ images from real low-quality inputs and use them as training targets to expand restoration data at scale.

Key Findings
  • Systematic evaluation of nine state-of-the-art MFMs across diverse scenes and degradation types showed substantial variation; Nano-Banana-2 with VLM-based adaptive prompting produced the most perceptually realistic and content-faithful HQ outputs in the authors' tests, and was chosen to build the pipeline. (So what: not all MFMs are equally suitable as synthetic GT sources.)
  • Constructed GGT-100K with 103,707 LQ–HQ training pairs and a 500-pair test set, produced via a multi-stage synthesis and quality-control pipeline. (So what: provides large-scale paired data reflecting complex, real degradations.)
  • Extensive experiments demonstrate that training or finetuning restoration models on GGT-100K consistently improves real-world generalization across model families, with especially strong gains when finetuning generative restorers. (So what: GGT can be an effective substitute/augmentation when real paired data are scarce.)
  • The pipeline emphasizes data reliability (filtering and QC), but the results still depend on the chosen MFM and prompting strategy. (So what: dataset quality is tied to the generator's fidelity.)
Who it's for and tradeoffs

Great fit if you are a researcher or practitioner who needs large-scale paired data to improve real-world image restoration generalization but lack the budget or logistics to capture and align physical HQ references. This dataset is particularly useful for finetuning generative restoration models and for benchmarking cross-domain robustness.

Look elsewhere if you require physically measured, sensor-accurate ground truth (e.g., scientific imaging or metrology), or if you cannot rely on external MFMs due to licensing, reproducibility, or deployment constraints. Synthetic HQ targets can still introduce subtle artifacts or distributional biases that differ from true optical measurements, so validation on real captured pairs remains important.

Where it fits

GGT-100K sits between purely synthetic degradations (which often underestimate real complexity) and small, expensive real paired datasets: it uses generative models to approximate HQ targets at scale, acting as a pragmatic data augmentation and domain-bridging resource rather than a complete substitute for carefully captured physical ground truth.

Information

  • Websitearxiv.org
  • AuthorsXiangtao Kong, Jixin Zhao, Lingchen Sun, Rongyuan Wu, Lei Zhang
  • Published date2026/05/29

More Items

Introduces WorldExam, a diagnostic benchmark that evaluates controllable video world models across four levels from visual quality to inherent world reactivity. Covers 1,474 cases across eight tasks and supports camera-, action-, and language-driven paradigms, measuring scene-conditioned reactions beyond explicit instructions.

Estimates the visually attributable portion of a privileged teacher’s next-token corrections and reconstructs student-anchored training targets for multimodal on-policy distillation. Uses counterfactual teacher queries and a signed proxy to raise supported tokens and suppress refuted ones, improving fine-grained visual knowledge transfer across model scales.

Hugging Face

Captures synchronized multimodal embodied-human data in real homes — egocentric and multi-view video, metric body/hand/object motion, audio, and tactile signals. Released under a gated non-commercial research license with identifiable participants and strict non-redistribution/privacy constraints.