GGUF quantized files for a Qwen3.6-35B checkpoint fine-tuned with Claude Opus 4.6-style chain-of-thought distillation to improve reasoning. Offers multiple llama.cpp-compatible quant options (Q4/Q5/Q6/Q8) for local text-generation inference.
Fine-tuned Qwen3.6-35B-A3B MoE that reproduces Claude Opus 4.7-style chain-of-thought with explicit <think>…</think> blocks. Offers sparse activation (256 experts, ~3B active params), 64k context, and GGUF builds for local inference; best for long, multi-step reasoning but may emit very long reasoning traces.
Provides a GGUF-packaged, native-INT4 quantized build of the multimodal Kimi K2.6 model for image-text-to-text inference — packaged for local/self-hosted inference engines (vLLM, SGLang, KTransformers) to reduce footprint while keeping multimodal capabilities.
Produces 384‑dim multilingual (and code) embeddings with up to 32,768 token context, optimized for low‑latency production retrieval. Compact 97M model with ONNX/OpenVINO and vLLM/GGUF deployment options for edge and high‑throughput use.
A 27B multimodal causal language model with a vision encoder and native long-context support (262,144 tokens). Optimized for repository-level coding agents and multimodal understanding; includes preserved "thinking" traces, multi-token prediction (MTP), and deployment recipes for vLLM / SGLang / Transformers.
FP8-quantized 27B multimodal Qwen3.6 model weights in Hugging Face Transformers format — supports image/text/video inputs, native 262k token context (extensible to ~1M), and is compatible with vLLM/SGLang/KTransformers for efficient local serving and research.
Provides a single OpenAI-compatible /v1 API that aggregates the free tiers of 16 LLM providers into one unified endpoint. Features smart routing and automatic failover, per-key free-tier tracking, encrypted key storage, embeddings/media routing, and a Docker one-liner for local use.
A 284B-parameter Mixture-of-Experts LLM with only 13B activated parameters, designed for 1,000,000-token contexts. Uses hybrid compressed attention and mixed FP4/FP8 precision to reduce long-context KV-cache and per-token FLOPs; aimed at long-document QA, RAG pipelines, and local/high-capacity inference.
Provides a locally runnable, refusal-free variant of Qwen3.6-27B with multiple K_P GGUF quantizations and mmproj multimodal support. The Aggressive flavor skips preambles on edgy prompts—use when you want direct/raw responses for local research, red‑teaming, or offline workflows.
A 14B dense tri‑mode language model that supports autoregressive, diffusion‑based parallel decoding, and self‑speculation—designed to increase token throughput and acceptance length; best suited for researchers and engineers exploring decode‑efficiency tradeoffs on NVIDIA hardware under the Nemotron Open Model License.
Provides an NVFP4-quantized 27B Qwen3.6 checkpoint optimized for faster, low-memory multimodal inference on 24GB GPUs. Includes MTP (multi-token prediction), extended 262k native context, and deployment recipes for vLLM/SGLang/KTransformers; best used with recommended backends for peak throughput.
A Qwen-3.6 27B model variant optimized for DFlash (speculative decoding) to reduce generation latency and increase throughput. Focuses on faster inference on serving stacks and is suitable for text-generation endpoints where lower latency and resource efficiency matter.