Generates persistent, explorable 3D worlds from a single image by synthesizing long-range, geometry-consistent video and reconstructing it into an explicit 3D Gaussian scene. Intended for internal research use under NVIDIA's research license.
An open text-to-image generation model built on an 8B Diffusion Transformer that focuses on layout-sensitive, text-heavy, and instruction-following image synthesis. Notable for accurate text rendering, structured/compositional generation (posters, comics), and ability to run on consumer 24GB GPUs when paired with prompt enhancement.
Provides 12.26M synthetically generated multilingual OCR samples (en/ja/ko/ru/zh) with word/line/paragraph bounding boxes and reading-order graphs, packaged as HDF5 shards for training detection, recognition, and layout models; licensed CC BY 4.0.
Benchmarks document-parsing systems on real-world enterprise PDFs and images—evaluates tables, charts, content faithfulness, semantic formatting, and visual grounding with human-verified, rule-level tests. Ships with ~2,000 pages, ~169K test rules, and an open evaluation framework for end-to-end pipeline scoring.
Generates and reconstructs navigable, editable 3D worlds from text, single images, multi-view photos, or video; outputs meshes and Gaussian Splatting assets and includes WorldMirror 2.0 for fast multi-view reconstruction. Suited for research and production pipelines that import assets into engines; requires substantial GPU resources.
Curated 100K subset of geometrically diverse CAD construction sequences sampled from a 1M agentically synthesized corpus — each item includes executable CadQuery scripts, 8 rendered views, STL/STEP exports, and precomputed DINOv3 embeddings for retrieval and benchmarking.
Provides a ~9.2M-instance Japanese multimodal post-training dataset for vision–language models, combining image–text pairs, PDF corpora and generated VQA to improve Japanese VLM performance; access is restricted by Japanese copyright (download via llm-jp GitLab).
Large-scale in-the-wild robot manipulation dataset with ~76K teleoperated trajectories (~350 hours) that provides synchronized multi-view video, depth, camera calibration, robot state/action traces, and natural-language task instructions to train and evaluate manipulation policies and dynamics models. Collected across 564 scenes, 86 tasks, 52 buildings, on a uniform Franka Panda hardware stack and released in LeRobotDataset v3.0 format (≈707 GB, OpenMDW1.1).
Delivers an ultra-efficient, edge-friendly multimodal image-and-video-to-text model optimized for on-device deployment. Uses mixed 4x/16x visual token compression, a low-FLOPs visual encoder, and multiple quantized variants for mobile and embedded inference.
Multimodal agent model for long-horizon coding, image-text understanding, and autonomous task orchestration. Built as a 1T-parameter Mixture-of-Experts with 256K context and native int4 quantization — intended for coding-driven design, persistent background agents, and swarm-style sub-agent workflows.
Provides paired before/after satellite images with question–answer annotations for semantic change understanding. Includes Yes/No and multiple-choice formats, delivered in Hugging Face datasets (streaming-friendly), suited for remote-sensing multimodal VQA and semantic change captioning research.
Open-weight multimodal 35B Qwen3.6 model in Hugging Face Transformers format that supports image/video/text inputs and native long contexts (262,144 tokens). Emphasizes agentic coding and preserved reasoning traces (thinking), uses an MoE-backed architecture and is designed for self-hosting with vLLM/SGLang/KTransformers; requires multi-GPU resources for production.