Converts video inputs into text outputs — supports captioning, temporal grounding, and video-text-to-text queries using a Qwen-3.5-2B finetuned multimodal backbone. Suited for prototyping video understanding and caption-generation pipelines.
Provides the full caption corpus used to train and ablate the i1 text-to-image model: 12 curated subsets with multiple caption variants (long/short, VLM-generated, rendered text) to enable reproducible training and captioning experiments.
Multimodal 35B scientific foundation model for image+text-to-text reasoning and conversational workflows. Uses task-scaling and full-chain training (pretraining → RL) to boost domain scientific abilities while keeping general multimodal reasoning and agent skills.
A GGUF-format 9B model derived from Qwen3.5, fine-tuned for agentic coding, tool-calling, reasoning and vision-capable multimodal prompts. Optimized for local 8‑bit inference on 16GB-class machines; community experimental release for research use.
Delivers image and video generation, editing, and understanding inside a single 3B-parameter multimodal model trained from scratch with a multi-task recipe. Notable for strong unified benchmarks at 3B scale; inference requires large GPU memory (≈40GB+ VRAM).
Reasoning-enhanced 27B dense LLM fine-tuned from Qwen3.6-27B and released in GGUF format for image-text-to-text and long-context reasoning. Augmented with Trace Inversion reconstructed chains, three-stage SFT curriculum and MTP/vision support; community research release.
W4A4-quantized build of a 25B-parameter multimodal LLM that produces text from image+text inputs and supports conversational tool use. Trades very small quality differences for much lower GPU memory and latency so inference can run on smaller accelerators (vLLM support).
Converts long-form multi-speaker audio/video into a compact, speaker-aware transcript with timestamps and anonymous speaker labels in one pass. Combines ASR and diarization in a single model, supports custom prompts/hotwords, and targets meetings, podcasts, interviews and long recordings.
End-to-end Python framework for training and serving NVIDIA's Cosmos world models (Cosmos3), integrating distributed training (FSDP/TP/CP/PP), DCP/safetensors checkpoints, dataset adapters, multiple inference backends, online serving, and agent skills.
Automates end-to-end web workflows from browser screenshots by emitting pixel-grounded actions (click, type, scroll, visit, search). Vision-first multimodal agent fine-tuned from Qwen3.5-27B with critical-point safety checks; intended for sandboxed, human-supervised deployments.
Generates temporally coherent MP4 videos from a single input image plus text instructions, with configurable resolution, frame count, and optional AAC audio. Optimized for NVIDIA GPU stacks and integrates with vLLM‑Omni and Hugging Face Diffusers for production inference and research workflows.
Generates audio-driven avatar videos from text, images, or audio inputs with production-grade stability (accurate lip sync, identity consistency) and an 8-step distillation inference mode for faster serving; suitable for broadcasting, virtual hosts, animation, and multi-person scenarios.