AI Model2026
GGUF conversions of Laguna S 2.1 for llama.cpp, including quantized builds (Q4_K_M, Q8_0, F16) and a small DFlash drafter for speculative decoding; configured for a 256K default context window and intended for local inference and serving with Poolside's llama.cpp fork.
AI Model2026
Provides low-bit quantized Hy3 (hy_v3) GGUF model weights and mixed-precision quantization recipes for running Hy3 on llama.cpp, with optional MTP self-speculative decoding and imatrix-based calibration for improved quality/speed trade-offs.
AI Model2026
Agentic coding and long-horizon text generation via a 118B-parameter Mixture-of-Experts LLM with a 1,048,576-token context window. Features 256 routed experts, native preserved-thinking (reasoning) control, speculative decoding draft models, and quantized checkpoints for lower-cost serving.
AI Model2026
Generates 2048-d multilingual text embeddings for retrieval and semantic search, suited for RAG and dense retrieval. Pruned and distilled from the Ministral-3 family into a ~1.14B BF16 model, supports long contexts (up to 32,768 tokens) and optimized for NVIDIA GPU inference.
AI Model2026
Policy-adaptive multimodal safety classifier that evaluates text and images against free-form natural-language policies and returns a continuous yes/no safety score. Produces a single-token verdict from a 3B-parameter model, supports multiple languages, and is designed for lightweight real-time moderation.
AI Model2026
GGUF-quantized releases (NEO IMATRIX + MTP) of a multi-stage fine-tuned, uncensored Qwen3.5-9B model with vision enabled and a native 256k context window—optimized for instruction following, reasoning and image-text-to-text workflows; released under Apache-2.0.
AI Model2026
Open preview checkpoint of a sparse Mixture-of-Experts causal LLM with ~314B total params (~13B active per token) and native 256K context for long-context multilingual text generation. Ships with custom modeling code (trust_remote_code) and a research/non-commercial use license.
AI Model2026
Provides GGUF-format quantized shards of Laguna S 2.1 for local or self-hosted inference—packaged for llama.cpp/llama-server and usable with vLLM/Transformers runtimes; targeted at long-context, agentic coding workloads.
AI Model2026
4-bit NVFP4 (W4A4) quantized pack of Upstage Solar Open2 250B for vLLM serving on NVIDIA Blackwell GPUs, preserving MoE routing and near-BF16 quality while cutting model size from 500.6 GB to 153.3 GB.
AI Model2026
A 250B-parameter mixture-of-experts LLM that activates 15B parameters per token to lower inference cost for agentic tasks—tool calling, long-context reasoning, and coding. Uses a hybrid softmax+linear-attention stack with 1M-token context and supports English, Korean, and Japanese; requires H200/B200-class GPUs to run efficiently.
AI Model2026
Provides a 2‑bit quantized build of Qwen3.6‑35B‑A3B for local serving via an OpenAI‑compatible HTTP API. Key features: 12.3 GB on disk, eschamoe mixed 2/3‑bit expert quantization with int8 dense layers, runs on a single 16–24 GB NVIDIA GPU and ships with Escha SGLang and ZML runtimes.
AI Model2026
A text-only open-weight MOE code model (35B total, 3B active) fine-tuned with SFT+RL for agentic coding; achieves strong agentic-code benchmarks, supports 262k context and deployment via Transformers/vLLM; vision weights are not included.