AIAny
AI Model2026
Icon for item

moonshotai/Kimi-K2.7-Code

An agentic multimodal coding model for long-horizon software tasks: MoE architecture (1T params, 32B activated), 256K context, image/video input, native int4 quantization and preserved chain-of-thought (thinking) mode. Tuned for multi-step coding workflows and vLLM/SGLang deployment.

Introduction

Kimi K2.7 Code matters because real-world software engineering problems are long-horizon, multimodal, and require retained intermediate reasoning across many steps — yet most models either lose context or discard their internal "thinking." K2.7 Code explicitly preserves reasoning (preserve_thinking) and increases token efficiency so agents can carry planning and tool-invocation state across long sessions.

Key Capabilities
  • Agentic coding workflows: Designed to act as an agentic coding assistant that chains reasoning and multi-step tool calls (preserve_thinking enabled by default), which helps on debugging, multi-file refactors, and end-to-end task completion where intermediate plans matter.
  • Large-context, multimodal reasoning: Supports up to 256K tokens and accepts image/video inputs via a 400M-parameter MoonViT vision encoder, making it suited for tasks that mix code, screenshots, or short videos (e.g., UI debugging, visual inspection of outputs).
  • MoE scale with token efficiency: Built as a 1T-parameter Mixture-of-Experts model with ~32B activated parameters per token and native INT4 quantization for more tractable inference footprints; recommended inference stacks include vLLM, SGLang, and KTransformers.
  • Developer ergonomics: Exposes OpenAI/Anthropic-compatible API primitives and examples (thinking-mode, image/video payloads, and preserve_thinking semantics) to integrate into agent frameworks and CLI-based coding tools.
Who it's for and tradeoffs

Great fit if you need an LLM to run multi-step coding tasks that must keep intermediate reasoning or tool state (e.g., automated debugging, multi-file patches, agentic CI workflows) and you can deploy on inference engines that support large MoE models and long contexts. Look elsewhere if you need a lightweight on-device model, deterministic small-model inference, or strict open-source licensing constraints — K2.7 Code is large (MoE design) and optimized for hosted or server-side inference with specialized runtimes. Also, while the model provides API examples, production integration requires attention to cost, tool-call budgeting, and evaluation on your own benchmarks.

Where it fits

Compared with smaller single-stream code models, K2.7 Code trades raw accessibility for sustained planning ability and multimodal context. Against closed commercial coding models it aims to improve long-horizon agentic behavior via preserved reasoning and very long contexts, at the cost of requiring MoE-capable inference infrastructure.

Quick notes on evaluation and deployment

The model card reports internal benchmarks showing improved performance over K2.6 on in-house coding and agentic suites; deployment guidance targets vLLM/SGLang/KTransformers and offers an OpenAI/Anthropic-compatible API surface. Native INT4 quantization is provided to reduce inference cost, but practical throughput will depend on your runtime and expert routing support.

Information

  • Websitehuggingface.co
  • AuthorsMoonshot AI (moonshotai)
  • Published date2026/06/11

Categories

More Items

Hugging Face
AI Model2026

GGUF-quantized build of Moonshot AI's Kimi K3 for local inference: MXFP4-aware quantization, image-text-to-text pipeline support, native vision and a 1,048,576-token context window. Intended for local GGUF runtimes (vLLM, SGLang, TokenSpeed) with Kimi K3 license constraints.

Hugging Face
AI Model2026

A GGUF-local variant of Qwen3.6-35B that applies a non-training 'Genesis' tensor-repair process and Hermes-agent fine-tuning to enable uncensored, multimodal (text+image) local inference. Highlights: MoE 35B spec, large native context, Hermes function-calling dataset transfer, and recommended quantization/runtime settings.

Hugging Face
AI Model2026

4-bit NVFP4 (W4A4) quantized pack of Upstage Solar Open2 250B for vLLM serving on NVIDIA Blackwell GPUs, preserving MoE routing and near-BF16 quality while cutting model size from 500.6 GB to 153.3 GB.