AIAny
AI Model2026
Icon for item

Jackrong/Qwopus3.6-27B-v1-preview-GGUF

A GGUF-format preview checkpoint derived from Qwen3.6-27B — a multimodal, image-text-to-text reasoning model fine-tuned for more structured reasoning and consistent answer style; packaged for local inference and compatible with engines like vLLM/SGLang/llama.cpp.

Introduction

This preview checkpoint matters because it makes a 27B multimodal reasoning stack practical to run and evaluate locally: it packages a Qwen3.6-27B–based supervised-fine-tuned checkpoint (Qwopus-style) in GGUF for fast experiments and iteration without relying on cloud-only deployments.

Key Capabilities
  • Multimodal image-text-to-text: tuned to accept images and text and produce structured, conversational answers, making it suitable for visual question answering and image-augmented assistants. This means you can prototype VQA and vision+instruction tasks on a 27B dense backbone.
  • Improved structured reasoning and style consistency: the fine-tuning recipe emphasizes coherent reasoning traces and reduced stylistic drift, so outputs tend to follow a more stable answer format across long interactions — useful for evaluation-oriented benchmarks and agentic workflows.
  • Local/quantized distribution (GGUF): provided as a GGUF artifact for local inference with popular engines (llama.cpp, vLLM, SGLang), lowering the barrier to offline testing, benchmarking, and integration into private deployments.
  • Practical training provenance: trained from a mixture centered on Kassadin88/Claude-Distillation-Dataset plus several Jackrong-curated reasoning sets; the released preview used ~12K curated reasoning examples and reports early local evaluations on a 16-prompt suite.
Who it's for & trade-offs

Great fit if you want to: run and iterate on a 27B multimodal reasoning model locally, evaluate structured reasoning or VQA workflows, or prototype agent/tool integrations without cloud-only dependencies. The preview is valuable for researchers and engineers who need a reproducible checkpoint compatible with common inference stacks.

Look elsewhere if you need: production-hardened releases (this is an early preview actively being improved), broad public evaluations (the current card provides an early directional evaluation only), or heavily safety-audited weights — those require later, larger-scale releases. Also expect that inference efficiency and latency depend strongly on your serving stack and hardware (an RTX 5090 was used in the author's local tests).

More Items

Hugging Face
AI Model2026

Answers structured decision questions (choice / yes-no / score) about text, images and videos in one call and returns probabilities for every option. A 27B multimodal model (includes a 0.46B vision encoder), supports zero-shot classification, image/video inputs and integrates with vLLM / vLLM Semantic Router for high-throughput serving. Apache-2.0.

Hugging Face
AI Model2026

Generates calibrated decisions (choice/score/noul) from a prompt and optional images, up to 256 options. Routed MoE experts are quantized to NVIDIA NVFP4 to reduce weights to ~25.6 GB and GPU memory to ~23.3 GiB; provided as a vLLM-compatible System 1 decision model with a /v1/decide endpoint.

Hugging Face
AI Model2026

Runs a 24B-parameter mixture-of-experts reasoning model with only ~2B active parameters per token for fast on-device agentic workflows; provides a 131K-token context and 128K vocabulary, post-trained for tool calling and agentic RL—pair with retrieval for knowledge-heavy tasks.