A small model’s practical value depends as much on whether it fits into a local runtime as on its benchmark scores. This Q4_K_M GGUF release packages NVIDIA’s post-trained Gemma-4-E4B-based model for that setting, targeting responsive assistants that can follow instructions and use tools across turns.
AI Model2026
NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF
Provides Q4_K_M GGUF weights for running Nemotron 3.5 Bolt E4B locally, with up to 64K-token context and support for multi-turn tool use.
Introduction
Information
- Websitehuggingface.co
- OrganizationsUnsloth, NVIDIA Corporation
- Published date2026/10/23
Categories
More Items
AI Model2026
Handles text, images, video, and audio in one model, then responds in text, speech, or both. Its 2.17B parameters and local-inference options target multimodal applications on edge devices.
AI Model2025
Converts Chinese and English documents and PDFs into text and structured content, including tables, formulas, charts, and extracted fields. It is designed to handle real-world inputs such as scans and photographs.
