AIAny
Icon for item

SolarWM-Data

Provides a unified, camera-conditioned, multi-source video dataset and reproducible processing pipeline for training long-horizon video world models. Key features: a canonical frame-aligned contract (visuals, camera geometry, captions, quality metadata), 1.43M canonical clips with portable releases and reconstruction tools; large download and some backbone assets carry separate licenses.

Introduction

Long-horizon interactive video world models fail mostly because training corpora are fragmented by source, temporal scale, camera geometry, and captioning style. SolarWM-Data attacks that upstream bottleneck by converting many heterogeneous video sources into a single, camera-conditioned, frame-aligned corpus and by separating expensive source preprocessing from mixture construction, making large-scale, reproducible world-model training practical.

What Sets It Apart
  • Unified canonical contract: each clip aligns raw frames, metric camera geometry, captions, quality metadata, selection decisions, and provenance — so models get consistent, camera-conditioned supervision across sources rather than noisy ad-hoc mixes.
  • Multi-source scale and portability: the release provides 1,425,694 canonical clips (reported corpus), with the processed dataset hosted as reader-ready shards (approx. 2.73 TB). Raw sources correspond to a much larger physical corpus, and rejected shards and selection metadata are preserved for reproducible filtering.
  • Backbone-native generations and latent payloads: published latent-wds and reader-ready generations for multiple backbones (examples include Wan 2.2 variants, MiniMax-H3, and LTX-2.5) so researchers can train or evaluate while preserving backbone representations and objectives.
  • Reproducibility & configurability: the repo includes annotations, deterministic test indexes, reconstruction tools, and recipes so you can rebuild raw webdataset shards, reweight sources, or define alternate mixtures without re-running source-level preprocessing.
Who It's For and Trade-offs

Great fit if you are training or benchmarking camera-conditioned, long-horizon video world models and need a single, reconfigurable multi-source corpus with provenance and camera metadata. It’s also useful if you want backbone-native latent generations for method comparisons. Look elsewhere if you need a small, instantly streamable dataset (this release is large to download) or if your project cannot accommodate mixed license constraints: code is Apache-2.0 but some bundled backbone assets use their own community licenses and some raw sources must be obtained under original terms.

Information

Categories

More Items

Hugging Face

Provides 22 curated Three.js-based cases for code-guided video generation across eight application categories. Each case bundles an editable scene (Three.js program), a 960×544 proxy video, a 1536×864 reference image, and a plain-text prompt for controlled video-generation evaluation.

Benchmark for evaluating agents' ability to deliver working AI systems in realistic customer environments: 95 end-to-end delivery tasks with scripted stakeholders and production-like systems, scored by improvement to the customer's business metric and penalized for stakeholder contact.

Hugging Face

Evaluates whether models can reconstruct executable 3D worlds from visual or textual inputs by providing Blender-based tasks, assets, and automated evaluation for code-driven realizations.