Most progress in video generation focuses on short clips and model‑specific pipelines; building interactive, long‑horizon world models instead requires consistent supervision across diverse datasets and support for heterogeneous video generators. SolarWM's central insight is to decouple heavy source preprocessing from mixture construction via a canonical, frame‑aligned data contract and to adapt heterogeneous backbones through lightweight, backbone‑native interfaces — enabling reproducible cross‑backbone training and long‑horizon causal rollouts without long‑video pretraining.
Key Findings
- Canonical multi‑source corpus: the pipeline converts ~1.43 million canonical clips from 10 datasets (real, synthetic, and game environments) into a single frame‑aligned representation that includes visual frames, metric camera geometry, captions, quality metadata, selection records, and provenance. So what: researchers can reconfigure mixtures (filters, sampling ratios, source weights) without redoing expensive source preprocessing.
- Backbone‑native adaptation: SolarWM preserves each video generator’s native representation and objectives, adding only interfaces for camera conditioning and rollout. So what: the same data and training recipe can be applied to diverse backbones (Wan2.2, LTX, MiniMax families) enabling fair cross‑backbone comparison and reuse.
- Simple three‑stage recipe: bidirectional adaptation (bidirectional training), teacher‑forced autoregressive (AR) initialization, and distribution matching distillation (DMD). So what: this pipeline yields causal, low‑latency generators that support minute‑to‑hour rollouts after being trained only on 5s sequences, avoiding expensive long‑sequence optimization.
- Scalable results: instantiations span 5B–33B parameters (SolarWM variants based on Wan2.2, LTX‑2.5, MiniMax‑H3) and demonstrate real‑time interactive rollouts across minutes to hours. So what: long‑horizon behavior emerges from proper data construction and staged adaptation rather than massive long‑sequence training.
Who it's for and tradeoffs
Great fit if you are a researcher or engineering team aiming to: reuse diverse video sources for world‑model training, compare or adapt multiple video generator backbones under a shared data contract, or build camera‑controllable, causal video rollouts for interactive applications. SolarWM is especially useful when you need reproducible mixtures and want to avoid reprocessing terabytes of raw sources. Look elsewhere if you require out‑of‑the‑box long‑video fine‑tuning workflows specialized for a single, proprietary backbone, or if you need productionized low‑latency distilled generators (the project releases recipes and weights but final inference latency depends on downstream distillation and serving work).
Where it fits
SolarWM sits between raw multi‑source dataset efforts and single‑backbone world‑model papers: it standardizes the data side (canonical corpus + reconfigurable mixture) and provides a lightweight, backbone‑preserving adaptation and training recipe so that community models and datasets can be evaluated and extended in a consistent, reproducible way.