Drop-in Jinja chat templates for Qwen 3.5/3.6 that fix rendering errors, token waste, and tool-calling failures across runtimes (LM Studio, llama.cpp, vLLM, MLX). Adds a think-on/think-off toggle, auto-closes broken thinking tags, robust tool-argument handling, and a graceful fallback for missing user queries.
Provides an NVFP4-quantized 27B Qwen3.6 checkpoint optimized for faster, low-memory multimodal inference on 24GB GPUs. Includes MTP (multi-token prediction), extended 262k native context, and deployment recipes for vLLM/SGLang/KTransformers; best used with recommended backends for peak throughput.
Unifies video, audio, image and text understanding for enterprise Q&A, summarization, transcription and document intelligence. The NVFP4 quantized variant reduces footprint to ~20.9GB for more efficient single‑GPU deployment and is tuned for NVIDIA runtimes (vLLM, TensorRT).
Provides unquantized BF16 weights of Qwen3.6-27B with the base model's MTP head grafted in for high-fidelity, uncensored text (and multimodal) generation. Includes deployment guidance and hardware-tuned variants for A100/H100 and Blackwell-class GPUs.
Provides multiple GGUF-quantized exports of Carnice V2 (a merged BF16 SFT of Qwen3.6-27B) optimized for llama.cpp and Hermes-style agent traces, with quant tiers targeted at 16–24GB local GPUs and agentic inference.
GGUF-format, DS4-optimized quantized weights for DeepSeek-V4-Flash, offering q2 (≈80.8 GiB) and q4 (≈153.3 GiB) variants plus an optional small MTP file for speculative decoding. Built for the DS4 inference engine; MIT-licensed.
Open-source Mixture-of-Experts LLM designed for extremely long-context (up to 1M tokens) text generation and agentic workflows; uses a hybrid attention + MTP design to reduce KV-cache footprint while enabling 42B active parameters and FP8 mixed-precision training.
Unified omnimodal foundation model for text, image, video and audio understanding and agentic workflows, with support for up to 1M-token context. Combines a sparse MoE LLM backbone, dedicated vision/audio encoders, multi-token prediction, and a hybrid sliding-window + global attention design to reduce KV-cache overhead.
Multilingual on-device translation model compressed to 1.25-bit via the Sherry quantization, supporting 33 languages and 1,056 directions in a 440MB package for offline mobile translation and demos.
Provides reusable Docker compose files, scripts and benchmarked configs to serve modern LLMs (Qwen, Gemma, etc.) on 1–2 NVIDIA RTX 3090/4090/5090 GPUs. Multi-engine (vLLM, llama.cpp, ik_llama), measured TPS/context tradeoffs, and validated single/dual‑GPU recipes.
An instruct-focused LLM (104B total, 7.4B active) optimized for fast, token-efficient inference in agent workflows. Uses hybrid linear attention plus a sparse MoE to raise throughput and cut token use; suited for high-frequency production agents, with some trade-offs in very deep reasoning.
Self-hosted sales CRM that runs native AI agents (RAG per tenant) to handle WhatsApp conversations, qualify leads, trigger automations and move deals through configurable pipelines. Multi-tenant with LGPD-minded controls and a one-command VPS installer for full data ownership.