A MoE causal large language model for long-horizon agents, coding, and multi-step reasoning: 2.4T parameters (95B activated), native 262,144-token context (extensible to 1,010,000), multi-token prediction, and configurable thinking-mode reasoning controls.
FP8-quantized checkpoint of the Qwen3.8 text-only causal LLM (2.4T params, 95B activated) for text-generation; preserves near-original performance, supports very long contexts (262k–1M), Mixture-of-Experts architecture, and is compatible with vLLM/SGLang/TokenSpeed. Thinking mode and preserve_thinking are enabled by default.
A GGUF release of Meta's Muse Glimmer 30B optimized for local multimodal agent inference; includes two quantized text builds, a perception encoder for image input, and an optional DFlash drafter for speculative decoding—fits on 24–32 GB VRAM.
Multimodal Mixture-of-Experts text-generation model that accepts text, images, video and audio and returns text; preview open-weight release with 280B total params, 16B activated params, up to 512K token context and BF16/FP8 checkpoints under Apache-2.0.
Runs a quantized, locally executable 29.6B multimodal causal language model optimized for agentic workflows. Includes a perception encoder for image+text input, 4-bit quantized weights for 24–32GB devices, a DFlash drafter for speculative decoding, and robust tool-call support.
Lightweight sparse-MoE LLM (7.9B params, ~1.3B activated per token) designed for hybrid multi-step reasoning and agentic tasks. Uses a KDA–MLA hybrid attention stack and a 128-expert sparse FFN; offered in BF16/FP8/INT4 for local and edge deployment.
Multimodal vision-language model optimized for on-device image+text tasks: image captioning, full-page OCR with layout annotation, grounding/bounding-box prediction, and function calling. Built on the LFM2.5-2.6B backbone with a SigLIP2 NaFlex 400M vision encoder and tuned for low-latency, low-memory edge inference.
Open-weight 30B-parameter Mixture-of-Experts LLM with 3B active params, NVFP4-quantized checkpoint, and speculative-decoding support for long-context (up to 1M tokens) agentic, chat, reasoning and tool-calling workloads optimized for NVIDIA GPUs.
Provides an FP8-post-trained 27B multimodal causal language model with a native vision encoder, large-context support (262,144 native, extensible to 1,000,000), controllable thinking-mode reasoning, and compatibility with common inference engines for deployment.
Provides a 27B Qwen3.8 GGUF build for local/offline deployment, optimized with Unsloth Dynamic V3.0 quantization. Offers switchable thinking-mode, native vision-language understanding, and native long-context support (262k+ tokens).
Provides a Mixture-of-Experts language model tuned for million-token contexts and agentic workflows, with DSpark speculative decoding, FP4/FP8 mixed-precision support, and vLLM/SGLang deployment recipes for low-latency production inference.
A 27B Qwen3.8 vision‑language causal transformer quantized to NVFP4 for lower‑memory inference. Provides 262K native context (extensible to 1M), Unsloth Dynamic V3.0 4‑bit quantization and MTP support so Qwen3.8‑class multimodal workloads can run on 24GB‑class GPUs.