AIAny
Icon for item

SolarWM-Data

Provides a unified, camera-conditioned, multi-source video dataset and reproducible processing pipeline for training long-horizon video world models. Key features: a canonical frame-aligned contract (visuals, camera geometry, captions, quality metadata), 1.43M canonical clips with portable releases and reconstruction tools; large download and some backbone assets carry separate licenses.

Introduction

Long-horizon interactive video world models fail mostly because training corpora are fragmented by source, temporal scale, camera geometry, and captioning style. SolarWM-Data attacks that upstream bottleneck by converting many heterogeneous video sources into a single, camera-conditioned, frame-aligned corpus and by separating expensive source preprocessing from mixture construction, making large-scale, reproducible world-model training practical.

What Sets It Apart
  • Unified canonical contract: each clip aligns raw frames, metric camera geometry, captions, quality metadata, selection decisions, and provenance — so models get consistent, camera-conditioned supervision across sources rather than noisy ad-hoc mixes.
  • Multi-source scale and portability: the release provides 1,425,694 canonical clips (reported corpus), with the processed dataset hosted as reader-ready shards (approx. 2.73 TB). Raw sources correspond to a much larger physical corpus, and rejected shards and selection metadata are preserved for reproducible filtering.
  • Backbone-native generations and latent payloads: published latent-wds and reader-ready generations for multiple backbones (examples include Wan 2.2 variants, MiniMax-H3, and LTX-2.5) so researchers can train or evaluate while preserving backbone representations and objectives.
  • Reproducibility & configurability: the repo includes annotations, deterministic test indexes, reconstruction tools, and recipes so you can rebuild raw webdataset shards, reweight sources, or define alternate mixtures without re-running source-level preprocessing.
Who It's For and Trade-offs

Great fit if you are training or benchmarking camera-conditioned, long-horizon video world models and need a single, reconfigurable multi-source corpus with provenance and camera metadata. It’s also useful if you want backbone-native latent generations for method comparisons. Look elsewhere if you need a small, instantly streamable dataset (this release is large to download) or if your project cannot accommodate mixed license constraints: code is Apache-2.0 but some bundled backbone assets use their own community licenses and some raw sources must be obtained under original terms.

Information

Categories

More Items

Hugging Face

A public dataset of one million real-world conversations with 25 LLMs, including conversation text, model name, detected language tags, and OpenAI moderation outputs — useful for studying prompt distributions, safety/moderation, and training/evaluating instruction-following models.

Hugging Face

Benchmark for evaluating general AI assistants with 466 short, real-world questions that require tool use, multimodality and reasoning; provides a public dev set and a withheld test set used for leaderboard evaluation.

Hugging Face

Provides Parquet-backed pretraining subsets of web and synthetic QA text for large-language-model training, including web-high-nltk-qa, web-high-medium, and txt360-qa. Offers streaming access, provenance metadata, and CC BY 4.0 licensing; intended for LM pretraining and research.