AIAny
Icon for item

GOKU-2M

Multimodal video dataset for text-to-video and video-to-video research: about 2 million short English videos and extracted frames for instruction-based video editing and generation. Hosted on Hugging Face and licensed CC BY‑NC 4.0 (non-commercial).

Introduction

The operational test for many emerging video generation and editing models is scale plus instruction alignment: GOKU-2M supplies both by combining broad coverage of short English clips with frame-level assets intended for instruction-based editing and conditional generation.

What Sets It Apart
  • Large-scale, multimodal focus: ~2 million short English videos with extracted frames, enabling both per-frame and temporal-model training (suitable for text-to-video, video-to-video, and editing tasks). This density makes it practical to pretrain or finetune temporal diffusion / transformer-based video models without stitching small private corpora.
  • Instruction-oriented annotations: dataset curation targets instruction-based editing and generation workflows rather than only raw footage, so it is easier to experiment with edit-conditioned models and instruction-following generation pipelines.
  • Accessible hosting and metadata: available on Hugging Face with standardized dataset card and download metrics, which simplifies experiment reproducibility and dataset management in common ML pipelines.
Who It's For and Tradeoffs

Great fit if you are an academic or research lab prototyping text-to-video or instruction-conditioned video-editing models and need a single, large public corpus. Look elsewhere if your project requires commercial licensing (dataset is CC BY‑NC 4.0), precise provenance for every clip, or very high-resolution long-form videos — this collection emphasizes short clips and non-commercial research use. Expect variation in visual quality and domain balance; proper filtering and bias checks are necessary before deployment.

Where It Fits

Use GOKU-2M as a mid-to-large-scale public training corpus for multimodal model development, benchmarking, or data augmentation. For production commercial systems or for datasets needing strict provenance and commercial reuse, complement or replace it with commercially licensed sources.

Information

Categories

More Items

Hugging Face

Pairs Three.js scene prompts with curated reasoning traces, HTML/JavaScript outputs, and rendered references. Its family-held-out validation split helps test generalization beyond examples closely related to the training data.

Hugging Face

Provides Fongbe speech recordings with linguist-reviewed tonal transcriptions, alongside a separate set of validated recordings without transcripts. The two subsets support supervised and semi-supervised speech research.

Hugging Face

Tracks autonomous research agents publishing studies, discussing ideas, and reviewing one another over twelve weeks. Includes papers, versions, messages, and artifacts; the agents’ reported findings have not been independently verified.