Runs a self-hosted web server and React-based UI to generate, edit, and manage images using Stable Diffusion, SDXL and other foundation models. Includes a model manager, unified canvas, node-based workflows, gallery, and support for ckpt, diffusers and some gguf checkpoints.
Web and desktop/mobile WebUI for generating, editing, captioning and processing images and videos with Stable Diffusion and many diffusion models. Key features include automatic model download, SDNQ on-the-fly quantization for VRAM savings, balanced CPU/GPU offload, multi-backend GPU support, and built-in captioning/tagging/upscaling workflows.
Applies quantization, pruning, distillation, speculative decoding and sparsity to compress and accelerate deep learning models, producing exportable checkpoints ready for deployment on TensorRT‑LLM, TensorRT, vLLM and similar inference runtimes.
Generates images from text prompts using a 12-billion-parameter rectified-flow transformer trained with guidance distillation for more efficient sampling. Distributed with diffusers/ComfyUI support and multiple conditioning/editing variants; weights released under a non-commercial license.
Provides an open platform of omnimodal world models, datasets, and tools to build Physical AI — joint perception, generation, and action reasoning for robots, autonomous vehicles, and smart infrastructure. Supports images, video, audio, and action-conditioned workflows.
Provides a curated collection of hands-on tutorials, workflows and auxiliary files for training and using generative-model tooling (Stable Diffusion, Flux, WAN). Key items include a WAN 2.1 LoRA training tutorial and an articles collection covering DreamBooth, LoRA, LyCORIS and SDXL.
Provides curated short video clips (49- and 81-frame) with layered ground truth—edit layers, alpha mattes, and composite targets—for training and evaluating content-preserving layered diffusion video editing. Contains background-replace and object-add edits; Apache-2.0 licensed.
Generates text by iteratively denoising blocks of tokens with a two-tower design: a frozen autoregressive context tower and a trainable diffusion denoiser tower, trading minimal quality loss for higher wall-clock throughput.
Unifies multimodal understanding, reasoning, and image generation in a single end-to-end architecture using the NEO-unify paradigm. Models pixels and words jointly without a separate visual encoder, and provides interleaved image–text generation, infographic editing, and GGUF/low‑VRAM inference options.
Provides the full caption corpus used to train and ablate the i1 text-to-image model: 12 curated subsets with multiple caption variants (long/short, VLM-generated, rendered text) to enable reproducible training and captioning experiments.
End-to-end Python framework for training and serving NVIDIA's Cosmos world models (Cosmos3), integrating distributed training (FSDP/TP/CP/PP), DCP/safetensors checkpoints, dataset adapters, multiple inference backends, online serving, and agent skills.
Generates temporally coherent MP4 videos from a single input image plus text instructions, with configurable resolution, frame count, and optional AAC audio. Optimized for NVIDIA GPU stacks and integrates with vLLM‑Omni and Hugging Face Diffusers for production inference and research workflows.