Generates high-fidelity images from text prompts using NVIDIA's 64B Cosmos3-Super multimodal foundation model. Integrates with Hugging Face Diffusers and vLLM‑Omni, is released under OpenMDW1.1 for commercial use, and is optimized for Physical AI workflows (robotics, AV, simulation).
Hybrid LFM2.5 text-generation model optimized for on-device assistants and agentic workflows — 8.3B total / 1.5B active parameters with 131,072-token context. Prioritizes low-latency, high-throughput inference and multilingual instruction-following; not optimized for pure heavy programming or knowledge-heavy QA without retrieval.
Performs training-free early-stage visual token compression inside the vision encoder to cut time-to-first-token (TTFT) and FLOPs for Video-LLMs. Introduces a decoupled spatial token selection strategy and reports up to 2.65× TTFT reduction and 61% FLOPs savings on LLaVA-OneVision-7B (NVIDIA A100) while preserving full-token accuracy — aimed at latency-sensitive video understanding.
GGUF quantizations of Step-3.7-Flash: a sparse multimodal Mixture-of-Experts LLM with native image understanding, selectable reasoning levels, and a 256K context window. Ships multiple calibrated Q3/Q4/IQ quant files plus an mmproj vision projector for local llama.cpp inference on high-memory hosts.
Enables real-time streaming video-to-video editing (1280×704 @24 FPS) on a single RTX 5090 GPU. Uses a Hybrid Diffusion Transformer for balanced local/global modeling, Cycle‑Reverse Regularization for temporal consistency, and system-level mixed-precision and fused kernels to maximize throughput.
Introduces Draft-OPD, an on-policy distillation method for training lightweight draft models used in speculative decoding — it focuses learning on draft-induced errors via target-assisted rollouts and replay, improving acceptance length and enabling >5× lossless LLM inference acceleration.
Reallocates injected noise energy across frequency bands to match a diffusion model's spectral bias, improving sampling fidelity without retraining. Uses a timestep- and frequency-dependent colored-noise schedule as a plug-and-play inference-time SDE solver; shows sizable FID drops on ImageNet-256.
A GGUF-quantized, locally runnable build of Gemma 4 12B Unified (image-text-to-text) packaged by unsloth; preserves multimodal (image/audio) input support under an Apache-2.0 license and is compatible with common GGUF runtimes and Unsloth Studio.
Generates and reasons about multimodal physical-world content—text, images, video, audio, and robot/action trajectories—conditioned on combinations of text, image, video and action inputs. The 64B “Super” variant targets Physical AI use cases and supports vLLM‑Omni, Diffusers, and action prediction.
Provides the renderer weights and inference code for Bernini’s video renderer, enabling text→video, image→video and video editing inference. Offers a ready diffusers-format bundle or safetensors checkpoints under Apache‑2.0; intended for multi‑GPU/Hopper inference and reproducible research.
Generates minute-level, multi-shot synchronized audio+video from a single text prompt, using a paired cross-modal memory to preserve character appearance and voice across shots. Uses DMD-distilled few-step inference for ~7.5× speedup; requires high-GPU memory and is released under the LTX-2 community license.
Agentic LLM for long-horizon, environment-driven workflows: decomposes goals, generates and executes code/tool calls, evaluates outputs, and iterates. The Pro variant emphasizes coding and terminal execution and is published for use with sglang and multi-node H100 deployment.