Unifies video, audio, image and text understanding for enterprise Q&A, summarization, transcription and document intelligence. The NVFP4 quantized variant reduces footprint to ~20.9GB for more efficient single‑GPU deployment and is tuned for NVIDIA runtimes (vLLM, TensorRT).
Cross-platform native video editor with hardware-accelerated processing and frame-accurate multi-track timeline; core editor is open-source and free while optional Pro AI features (natural-language editing, auto-captions, smart reframing) are paid.
Unified omnimodal foundation model for text, image, video and audio understanding and agentic workflows, with support for up to 1M-token context. Combines a sparse MoE LLM backbone, dedicated vision/audio encoders, multi-token prediction, and a hybrid sliding-window + global attention design to reduce KV-cache overhead.
Provides a GGUF-quantized build of NVIDIA's Nemotron 3 Nano Omni 30B (Reasoning) for local inference — enables multimodal (video/audio/image/text) reasoning, transcription, and document understanding on compatible runtimes such as llama.cpp, Ollama, vLLM, and TensorRT-LLM.
Large-scale synthetic video dataset of 236,937 1080p clips (≈5,841 hours) of digital humans with per-frame metric depth and camera parameters — built as a controllable supplement for world-model pretraining, camera-motion generalization, and geometry-aware physical-AI research.
Generates uncensored videos from text and images using an LTX 2.3–based diffusion model with native t2v and i2v support; ships with a prompt enhancer and developer-focused gguf/bf16 dev releases for local experimentation.
Large-scale synthetic video dataset of physically simulated multi-object interaction scenes for training and evaluating models on physical reasoning, depth and optical-flow estimation, instance segmentation, and physics-grounded captioning. Provides RGB + lossless depth, per-frame instance masks, per-object physics annotations (NPZ), VLM-grounded captions, and USD scene files — useful for world-model and simulation-to-real work; commercial use permitted.
Open egocentric multimodal dataset for embodied AI and robot learning captured on commodity iPhone Pro: ~200 hours and ~10M RGB frames with LiDAR depth, ARKit 6‑DoF poses, IMU, two‑hand MANO mocap, room meshes, and hierarchical action captions.
Provides tick-aligned Counter-Strike 2 player POV video clips with per-tick inputs and world-state sidecars — near-lossless 1280×720@32fps video, per-player stereo audio, and parquet indexes for event/kill/round filtering; suited for RL, video classification and clip mining.
Converts video inputs into text outputs — supports captioning, temporal grounding, and video-text-to-text queries using a Qwen-3.5-2B finetuned multimodal backbone. Suited for prototyping video understanding and caption-generation pipelines.
Delivers image and video generation, editing, and understanding inside a single 3B-parameter multimodal model trained from scratch with a multi-task recipe. Notable for strong unified benchmarks at 3B scale; inference requires large GPU memory (≈40GB+ VRAM).
Generates minute-scale, 720p videos from a single image using a 2.6B image-to-video diffusion transformer with precise 6‑DoF camera control and an optional LTX‑2 refiner; designed for long-context, memory-efficient modeling but requires large refiner checkpoints (~41 GB).