AIAny
Icon for item

Posterior Matching Distillation

Distills a diffusion teacher’s conditional image distribution by matching exponentially tilted student means to teacher posterior means. It supports flexible sampling budgets on the trained timestep grid while preserving generation diversity.

Introduction

Fast diffusion generation usually comes with a diversity trade-off: reverse-KL distillation tends to concentrate on dominant modes. The key idea here is that a teacher’s posterior mean at a shifted noisy input acts as the mean of an exponentially tilted posterior—so a single teacher evaluation can supervise how probability is distributed across modes, not just where the average prediction lies.

Key Findings
  • Matching tilted means over an open neighborhood identifies the full conditional posterior in the paper’s theoretical setting. This turns a family of mean constraints into supervision for both possible outputs and their probabilities.
  • The student can generate multiple clean-image predictions from the same noisy state using independent randomness. This directly targets conditional diversity rather than forcing every individual prediction toward one teacher mean.
  • The method learns clean-image posteriors at noise levels rather than explicit transitions between noise levels. At sampling time, a prediction can be re-noised to a selected next level, allowing different step budgets within the trained timestep grid without additional training.
  • In the reported four-step comparisons, it achieves the best FID among evaluated methods on SDXL and FLUX.2 [klein] 4B, and reports consistent gains on intra-prompt diversity metrics. These results make it especially relevant when varied outputs matter alongside fast generation.
Who Should Consider It

A good fit for researchers studying few-step text-to-image generation who want to retain multiple plausible outputs for a prompt, not merely reproduce a dominant mode. Look elsewhere if training cost or simplicity is the priority: the method needs multiple student samples per training condition and still uses an auxiliary adversarial loss to improve visual realism. Its evidence is also focused on the tested image models and settings.

Information

  • Websitearxiv.org
  • OrganizationsVirginia Tech, NVIDIA
  • AuthorsHidir Yesiltepe, Julius Berner, Arash Vahdat, Pinar Yanardag
  • Published date2026/11/19

More Items

Introduces a multimodal lens for tracing how vision-language models represent visual concepts and selectively access them in response to questions. Counterfactual tests examine how those concepts affect later reasoning; the work does not claim models are conscious.

Tests multimodal models’ spatial reasoning through screen-based clicks and drags. Its programmatically generated CAPTCHA tasks also form a training environment, with fine-tuning gains reported across seven out-of-distribution benchmarks.

Coordinates visual and audio forensic agents to locate and verify signs of AI-generated video. Its dual-timescale training improves both the investigation strategy and the specialist inspectors.