AI Model2026
GGUF-format quantized release of DeepSeek‑V4‑Flash for local inference — compatible with llama.cpp and Unsloth runtimes, with guidance for FP4/FP8 mixed precision and Q4/Q8 quantization; tuned for million-token long-context usage.
AI Model2026
Provides pre-converted colibrì-format int4 weights so GLM-5.2 (744B MoE) can run by streaming routed experts from disk on a consumer machine with ~25 GB RAM. Includes MTP shard for lossless speculative decoding; requires the colibrì engine and ~400 GB NVMe.
AI Model2026
A GGUF-format Qwen3.6 35B base model image-text-to-text release repaired via tensor-level SVD/scale correction and packaged with Hermes agent tweaks; multimodal (vision + text), MoE architecture, ready for GGUF runtimes like llama.cpp.
AI Model2026
GGUF conversions of Laguna S 2.1 for llama.cpp, including quantized builds (Q4_K_M, Q8_0, F16) and a small DFlash drafter for speculative decoding; configured for a 256K default context window and intended for local inference and serving with Poolside's llama.cpp fork.
AI Model2026
GGUF-quantized builds of a 1B 'Thinking' MiniCPM5 model fine-tuned on Fable 5 (V2) for local runtimes; enhances tool/function-calling, coding and instruction-following, and supports long contexts (up to 128K tokens).
AI Model2026
Provides low-bit quantized Hy3 (hy_v3) GGUF model weights and mixed-precision quantization recipes for running Hy3 on llama.cpp, with optional MTP self-speculative decoding and imatrix-based calibration for improved quality/speed trade-offs.
AI Model2026
GGUF-quantized releases (NEO IMATRIX + MTP) of a multi-stage fine-tuned, uncensored Qwen3.5-9B model with vision enabled and a native 256k context window—optimized for instruction following, reasoning and image-text-to-text workflows; released under Apache-2.0.
AI Model2026
Adds vision to GLM-5.2 by attaching a MoonViT encoder and a trained 49.5M-parameter PatchMerger projector to enable image→text multimodal reasoning; text and vision backbones are frozen, uses NVFP4 quantized weights and targets Blackwell B200 GPUs.
AI Model2026
Provides GGUF-format quantized shards of Laguna S 2.1 for local or self-hosted inference—packaged for llama.cpp/llama-server and usable with vLLM/Transformers runtimes; targeted at long-context, agentic coding workloads.
AI Model2026
4-bit NVFP4 (W4A4) quantized pack of Upstage Solar Open2 250B for vLLM serving on NVIDIA Blackwell GPUs, preserving MoE routing and near-BF16 quality while cutting model size from 500.6 GB to 153.3 GB.
AI Model2026
A 250B-parameter mixture-of-experts LLM that activates 15B parameters per token to lower inference cost for agentic tasks—tool calling, long-context reasoning, and coding. Uses a hybrid softmax+linear-attention stack with 1M-token context and supports English, Korean, and Japanese; requires H200/B200-class GPUs to run efficiently.
AI Model2026
Provides a 2‑bit quantized build of Qwen3.6‑35B‑A3B for local serving via an OpenAI‑compatible HTTP API. Key features: 12.3 GB on disk, eschamoe mixed 2/3‑bit expert quantization with int8 dense layers, runs on a single 16–24 GB NVIDIA GPU and ships with Escha SGLang and ZML runtimes.