AIAny
AI Model2026
Icon for item

KAT-Coder-V2.5-Dev

A text-only open-weight MOE code model (35B total, 3B active) fine-tuned with SFT+RL for agentic coding; achieves strong agentic-code benchmarks, supports 262k context and deployment via Transformers/vLLM; vision weights are not included.

Introduction

Most modern code agents struggle to combine long-horizon context, stable tool usage, and RL-driven behavior refinement in a single open-weight release. This release exposes a post-trained MOE code model that was specifically tuned to reduce pathological tool calls and repetition while improving pass rates on agentic coding benchmarks, making it useful for researchers and teams experimenting with agentic coding stacks.

What Sets It Apart
  • Targeted post-training recipe: built on Qwen3.6-35B-A3B and post-trained via supervised fine-tuning (127K examples) followed by RL with safeguards (TITO, Truncated Importance Sampling, sandbox verifiers) to stabilize policy updates for agentic workflows.
  • Concrete scale and architecture: a Mixture-of-Experts model with 35B total parameters and ~3B activated parameters, optimized for tool-using coding agents rather than multimodal inference.
  • Measured improvements: reported SWE-bench Verified 69.40, SWE-bench Multilingual 63.00, PinchBench 93.43, and competitive Terminal-Bench/Scicode/KAT-Code-Bench scores versus several 30–35B peers.
  • Long-context and deployment-ready: native support for up to 262,144 tokens (with YaRN/rope overrides for longer horizons) and explicit guidance for running via vLLM, SGLang, Transformers and KTransformers as text-only model.
Who It's For & Tradeoffs

Great fit if you are a researcher or engineering team who needs an open-weight agentic coding model to: iterate on tool-use policies, run agent-in-the-loop code synthesis evaluations, or benchmark agentic coding harnesses. The release is explicit about being text-only: the vision/multimodal tower is not included, so it is unsuitable if you need multimodal capabilities out of the box. Serving requires significant GPU resources (tensor parallel setups are recommended) and careful inference flags (language-model-only / rope overrides) to avoid initialization errors.

Where It Fits

Use this model when you want an open checkpoint that: (a) reproduces RL-stabilization techniques for agentic coding, (b) integrates with common inference stacks (vLLM/sglang/transformers), and (c) supports ultra-long contexts. Look elsewhere for lightweight on-device models, turnkey multimodal agents, or proprietary hosted LLM services.

Information

  • Websitehuggingface.co
  • OrganizationsKwaipilot, KwaiKAT Team
  • Published date2026/07/23

More Items

Hugging Face

Provides ~483K agent instruction‑tuning trajectories for supervised fine‑tuning, including tool calls, environment feedback, errors/retries and verification across search, code, office and general agent workflows; static snapshots for SFT and mix‑ratio studies.

Hugging Face
AI Model2026

Compact causal LLM for on-device assistants, coding agents and long-context tool use — ~2.52B parameters with a 131,072-token context, trained with SFT + RL + OPD and released with its UltraData training corpora and multi-format deployment checkpoints.

Hugging Face
AI Model2026

Provides a cybersecurity-focused CRACK variant of GLM-5.3 FP8 that reduces refusals for offensive-security, red-team, exploit-development and malware-analysis queries while retaining native FP8 speed on Hopper GPUs; MIT-licensed for authorized security work.