AIAny
AI Model2026
Icon for item

MOSS-Image-SFT-8-steps-dmd

Distills MOSS-Image-SFT from a 50-step, CFG-guided process into image generation with eight network evaluations and no CFG. The checkpoint is still a work in progress.

Introduction

Reducing a 50-step image-generation process to eight evaluations is not just a speed tweak: it changes how the model uses its own intermediate predictions. This experimental distillation aims to retain the parent model’s image-generation behavior while removing classifier-free guidance and most repeated transformer calls.

What Sets It Apart
  • Data-space DMD: Each iteration feeds the generator’s clean estimate back alongside fixed noise, rather than simply replaying the original scheduler. This is the central change behind the short sampling trajectory.
  • No CFG at inference: The target is eight network evaluations without the usual guided and unguided forward-pass pair, reducing inference work compared with the parent model’s default setup.
  • Scene-graph-oriented training: Training uses compact JSON scene_graph captions, connecting the distillation to structured descriptions of image content and layout.
  • An early checkpoint, not a finished replacement: The published EMA checkpoint is update 2600 of a planned 12000. Treat quality and compatibility as experimental rather than assuming parity with the 50-step source model.
Who It’s For

A good fit for MOSS-Image-SFT users who want to experiment with faster generation or structured layout prompts, especially in ComfyUI. Look elsewhere if you need a stable, fully validated drop-in replacement: this is work in progress, and its distilled behavior depends on the supplied adapter and sampler setup.

More Items

Coordinates parallel subagents to tackle long-horizon tasks, then checks progress and evidence to revise its approach. It also supports exploratory science with inspectable research artifacts.

Hugging Face
AI Model2026

Uses repeated passes through shared layers to spend more computation on each token and strengthen reasoning. Adjustable loop counts trade inference cost for accuracy, with context lengths up to 256K tokens.

Hugging Face
AI Model2026

Removes the base model’s refusal behavior through weight-level edits while retaining its FP8/FP4 format, million-token context, multimodal input, reasoning modes, and tool use. Running it requires FP8-capable hardware.