GGUF-format, DS4-optimized quantized weights for DeepSeek-V4-Flash, offering q2 (≈80.8 GiB) and q4 (≈153.3 GiB) variants plus an optional small MTP file for speculative decoding. Built for the DS4 inference engine; MIT-licensed.
Open-source Mixture-of-Experts LLM designed for extremely long-context (up to 1M tokens) text generation and agentic workflows; uses a hybrid attention + MTP design to reduce KV-cache footprint while enabling 42B active parameters and FP8 mixed-precision training.
Unified omnimodal foundation model for text, image, video and audio understanding and agentic workflows, with support for up to 1M-token context. Combines a sparse MoE LLM backbone, dedicated vision/audio encoders, multi-token prediction, and a hybrid sliding-window + global attention design to reduce KV-cache overhead.
Provides a GGUF-quantized build of NVIDIA's Nemotron 3 Nano Omni 30B (Reasoning) for local inference — enables multimodal (video/audio/image/text) reasoning, transcription, and document understanding on compatible runtimes such as llama.cpp, Ollama, vLLM, and TensorRT-LLM.
Multilingual on-device translation model compressed to 1.25-bit via the Sherry quantization, supporting 33 languages and 1,056 directions in a 440MB package for offline mobile translation and demos.
Converts latent representations into high-resolution images by using a conditional pixel-space diffusion decoder that merges decoding and upsampling into a single generative step. Released checkpoints are 4-step distilled (2k and 2kto4k variants) and pair with specific VAE/encoder weights; license restricts use to non-commercial research.
An instruct-focused LLM (104B total, 7.4B active) optimized for fast, token-efficient inference in agent workflows. Uses hybrid linear attention plus a sparse MoE to raise throughput and cut token use; suited for high-frequency production agents, with some trade-offs in very deep reasoning.
A trillion-parameter LLM optimized for long-context, low-latency text generation and agentic coding workflows. Combines MLA+Linear Attention and a post-training 'fast thinking' token-suppression strategy to reduce token overhead and improve multi-step execution reliability for production agents.
Distills DeepSeek‑V4's multi-step structured reasoning into a Qwen3.5‑9B model for fast image-text-to-text reasoning and agentic tool workflows. Trades larger teacher size for inference efficiency and improved procedural reasoning — good for low-latency research, evaluation, and agent integration.
Unified 4B vision-language model for document understanding that converts images or text into template-driven structured JSON or clean Markdown. Key features: multimodal inputs (image+text), template-based extraction, reasoning vs non-reasoning modes, and vLLM/OpenAI-compatible deployment for OCR, invoice/forms extraction, and RAG preprocessing.
An uncensored, fine-tuned and GGUF-quantized variant of Qwen3.6-27B tailored for long-context, coding, vision and creative-writing use. Offers multiple NEO-CODE Di-Matrix quants (IQ2/IQ4/Q6/Q8), mmproj vision support and recommended inference settings for local servers.
Draft model for speculative decoding that uses a lightweight block-diffusion drafter to propose multiple tokens in parallel; designed to pair with google/gemma-4-31B-it and accelerate autoregressive text generation (official benchmarks report up to ~5.8× throughput).