An uncensored, fully unlocked GGUF port of Qwen 3.6‑35B‑A3B for local multimodal (text+image) inference, offering K_P 'Perfect' quant variants (Q8–Q2) and an mmproj for vision. Suited for offline research and experimentation; not for use-cases requiring safety filters.
GGUF quantized files for a Qwen3.6-35B checkpoint fine-tuned with Claude Opus 4.6-style chain-of-thought distillation to improve reasoning. Offers multiple llama.cpp-compatible quant options (Q4/Q5/Q6/Q8) for local text-generation inference.
Fine-tuned Qwen3.6-35B-A3B MoE that reproduces Claude Opus 4.7-style chain-of-thought with explicit <think>…</think> blocks. Offers sparse activation (256 experts, ~3B active params), 64k context, and GGUF builds for local inference; best for long, multi-step reasoning but may emit very long reasoning traces.
Provides a GGUF-packaged, native-INT4 quantized build of the multimodal Kimi K2.6 model for image-text-to-text inference — packaged for local/self-hosted inference engines (vLLM, SGLang, KTransformers) to reduce footprint while keeping multimodal capabilities.
Unified multimodal LLM for enterprise workflows: ingests video, audio, image and text to perform transcription, OCR, Q&A, summarization and long-context reasoning. Provides BF16/FP8/NVFP4 weights and integrations with vLLM, TensorRT-LLM and other runtimes.
Produces 384‑dim multilingual (and code) embeddings with up to 32,768 token context, optimized for low‑latency production retrieval. Compact 97M model with ONNX/OpenVINO and vLLM/GGUF deployment options for edge and high‑throughput use.
A 27B multimodal causal language model with a vision encoder and native long-context support (262,144 tokens). Optimized for repository-level coding agents and multimodal understanding; includes preserved "thinking" traces, multi-token prediction (MTP), and deployment recipes for vLLM / SGLang / Transformers.
FP8-quantized 27B multimodal Qwen3.6 model weights in Hugging Face Transformers format — supports image/text/video inputs, native 262k token context (extensible to ~1M), and is compatible with vLLM/SGLang/KTransformers for efficient local serving and research.
Provides a single OpenAI-compatible /v1 API that aggregates the free tiers of 16 LLM providers into one unified endpoint. Features smart routing and automatic failover, per-key free-tier tracking, encrypted key storage, embeddings/media routing, and a Docker one-liner for local use.
A 284B-parameter Mixture-of-Experts LLM with only 13B activated parameters, designed for 1,000,000-token contexts. Uses hybrid compressed attention and mixed FP4/FP8 precision to reduce long-context KV-cache and per-token FLOPs; aimed at long-document QA, RAG pipelines, and local/high-capacity inference.
Generates conversational and reasoning outputs with support for million‑token contexts; uses a hybrid attention + MoE design to cut long‑context inference FLOPs and KV cache. Suited for long‑document retrieval, coding and complex reasoning; MIT licensed.
A vision-oriented foundation checkpoint for low-latency inference — DeepSeek V4 base in safetensors with FP8 optimizations. Designed for fast image generation and embedding use in inference pipelines; verify license and FP8/runtime compatibility before production use.