AIAny
Icon for item

SenseNova Vision Corpus 50M

Provides ~50M multimodal annotations organized for unified training across structured visual understanding, segmentation, dense geometric prediction, and multi-view reconstruction — released as task-specific JSONL files that reference original image assets rather than redistributing raw images.

Introduction

Most public vision corpora are task-siloed and inconsistently annotated, which complicates training unified multimodal models. SenseNova Vision Corpus 50M reorganizes open-source visual data into task-specialized, training-ready supervision across structured perception, segmentation, dense geometry, and multi-view geometry, making it practical to train or evaluate models that need consistent, multi-task visual signals.

What Sets It Apart
  • Unified task families: consolidates 73 dataset-task entries across 10 task types (structured understanding, segmentation, dense geometric prediction, multi-view geometry), so you can assemble multi-task training mixes without manual reformatting.
  • Task-aware curation pipelines: uses pipelines (Rex-Omni adaptations, MoGe-2 densification, LingBot-Depth) to turn sparse or inconsistent annotations into more training-compatible labels — this reduces per-dataset preprocessing overhead.
  • Asset referencing strategy: JSONL annotations keep relative file paths instead of embedding RGB assets, avoiding redistribution issues but requiring users to align a local root with original image sources.
  • Scale and balance: provides tens of millions of frames distributed across complementary task families (e.g., ~18.9M structured, ~17.3M dense-geometry frames), enabling both dense-prediction and high-level multimodal supervision at scale.
Who It's For and Tradeoffs

Great fit if you are training or evaluating multimodal vision models that need consistent supervision across geometry, segmentation, and structured tasks, or if you want to build multi-task curricula without stitching dozens of ad-hoc dataset formats. Look elsewhere if you cannot obtain or reconcile the original image assets (annotations reference file paths, not raw images), if you require a permissive commercial license (dataset uses CC BY-NC 4.0), or if you need datasets exclusively containing proprietary or private image collections. The corpus reduces annotation heterogeneity but shifts effort to dataset rooting and asset alignment.

Information

Categories

More Items

Benchmarks assistant-style, multi-turn interaction for omni-modal LLMs on real-time video by reverse-engineering Internet clips into guided multi-turn interactions. It provides predefined priors and segment-level constraints so models must follow exact routes while being evaluated on answer correctness, timing, visual-prompt handling, and context retention.

Hugging Face

Provides a CC0-licensed corpus of 11,045,085 Turkish court decisions (1962–2026) in Parquet: 31.5 billion characters, 5.5 GB—designed for retrieval, summarization, classification and RAG workflows.

Hugging Face

A small public sample of egocentric human demonstration video with synchronized 3D hand and body pose annotations for imitation learning and embodied-AI research. Delivered in Parquet and common multimodal packages (LeRobot, MCAP) for schema inspection before requesting gated access to larger EgoSuite releases.