AIAny
AI Model2026
Icon for item

Jackrong/Qwopus3.6-27B-v1-preview-GGUF

A GGUF-format preview checkpoint derived from Qwen3.6-27B — a multimodal, image-text-to-text reasoning model fine-tuned for more structured reasoning and consistent answer style; packaged for local inference and compatible with engines like vLLM/SGLang/llama.cpp.

Introduction

This preview checkpoint matters because it makes a 27B multimodal reasoning stack practical to run and evaluate locally: it packages a Qwen3.6-27B–based supervised-fine-tuned checkpoint (Qwopus-style) in GGUF for fast experiments and iteration without relying on cloud-only deployments.

Key Capabilities
  • Multimodal image-text-to-text: tuned to accept images and text and produce structured, conversational answers, making it suitable for visual question answering and image-augmented assistants. This means you can prototype VQA and vision+instruction tasks on a 27B dense backbone.
  • Improved structured reasoning and style consistency: the fine-tuning recipe emphasizes coherent reasoning traces and reduced stylistic drift, so outputs tend to follow a more stable answer format across long interactions — useful for evaluation-oriented benchmarks and agentic workflows.
  • Local/quantized distribution (GGUF): provided as a GGUF artifact for local inference with popular engines (llama.cpp, vLLM, SGLang), lowering the barrier to offline testing, benchmarking, and integration into private deployments.
  • Practical training provenance: trained from a mixture centered on Kassadin88/Claude-Distillation-Dataset plus several Jackrong-curated reasoning sets; the released preview used ~12K curated reasoning examples and reports early local evaluations on a 16-prompt suite.
Who it's for & trade-offs

Great fit if you want to: run and iterate on a 27B multimodal reasoning model locally, evaluate structured reasoning or VQA workflows, or prototype agent/tool integrations without cloud-only dependencies. The preview is valuable for researchers and engineers who need a reproducible checkpoint compatible with common inference stacks.

Look elsewhere if you need: production-hardened releases (this is an early preview actively being improved), broad public evaluations (the current card provides an early directional evaluation only), or heavily safety-audited weights — those require later, larger-scale releases. Also expect that inference efficiency and latency depend strongly on your serving stack and hardware (an RTX 5090 was used in the author's local tests).

More Items

Hugging Face
AI Model2026

GGUF-quantized, refusal-removed build of Qwen3.8-Flash-Next for llama.cpp that provides multimodal (image+text), reasoning and tool-calling capabilities; released for security research and red-teaming under the Apache-2.0 license.

Hugging Face
AI Model2026

A dynamically quantized GGUF build of Ornith-1.5-35B optimized for agentic code-fixing and multi-turn conversations: targets 4-bit/≈22GB deployments, includes a vision projector, a custom importance matrix and a concise chat template.

Hugging Face
AI Model2026

Open-weights LLM fine-tuned for phone-based voice agents that prioritizes low latency and reliable tool/function calling. Based on NVIDIA Nemotron 3 Nano (30B total, 3.5B active), supports very long contexts (262,144 tokens) and recommends temperature=0 with thinking disabled for deployment.