AIAny
AI Model2026
Icon for item

MiMo-V2.6-Flash-RL

A sparse-MoE multimodal LLM fine-tuned with large-scale mixed reinforcement learning, supporting text/image/video/audio and a 1M-token context window; designed for long-horizon agentic tasks, coding and visual reasoning with groupwise grading and on-policy distillation.

Introduction

Why this matters

MiMo-V2.6-Flash-RL targets a practical research axis: scaling reinforcement-learning compute, task diversity and grader capacity together so a single multimodal model can continuously improve across long-horizon, multi-agent tasks. Instead of separate per-domain RL runs, Flash runs mixed RL at very large batch sizes and uses groupwise grading and on-policy distillation to produce measurable capability gains without per-task isolation.

Key Capabilities
  • Mixed RL at scale: Trained with fully asynchronous Group Relative Policy Optimization on very large hybrid batches (example training steps use 1,568 prompts × 16 rollouts), producing dense, comparative rewards that prioritize higher-quality passing rollouts.
  • Sparse MoE multimodal backbone: 309B total / ~15B active parameters, hybrid Sliding Window + Global attention, native support for text, image, video and audio, and an extreme 1M-token context length for long-repository, multi-session and tool-driven traces.
  • Agentic grading and distillation: Groupwise Reward Synthesis (GRS) and Groupwise Advantage Redistribution (GAR) form a closed self-improvement loop; Multi-Prefix Multi-Teacher On-Policy Distillation (MOPD2) transfers dense, token-level teacher signals into the student without regenerating long histories.
  • Practical inference features: 5-layer Multi-Token Prediction (MTP) speculative decoder, FP8 support recommendations, and SGLang/vLLM deployment recipes to reduce rollout costs and accelerate agentic workflows.
Who it fits and trade-offs

Great fit if you are building or researching long-horizon multimodal agents, RL-driven capability scaling, or code/visual agent pipelines and have access to large compute or distributed inference stacks. It provides a research-ready checkpoint and accompanying RL environments and harnesses for reproducing or extending large mixed-RL experiments.

Look elsewhere if you need a lightweight model for edge devices or simple single-turn chat: Flash requires specialized sparse-MoE inference infrastructure, significant GPU resources for fine-tuning or serving at scale, and careful safety/hardening when used for security-related tasks. Its strengths come with higher deployment complexity and compute costs compared with compact dense models.

Quick positioning

MiMo-V2.6-Flash-RL is positioned as an open checkpoint for community RL and agent research: it emphasizes mixed-domain RL, comparative grading, and distillation to make large, multimodal, long-context models improve autonomously. Use it for experiments that need long contexts, multimodal perception, and agentic evaluation loops; prefer smaller/dense alternatives for constrained-production or low-latency use cases.

Information

  • Websitehuggingface.co
  • OrganizationsXiaomi MiMo Team, Xiaomi Corporation
  • Published date2026/09/21

Categories

More Items

Hugging Face
AI Model2026

Quantizes DeepSeek-V4.1-Flash-1017’s routed MoE experts and activations to NVFP4 for inference deployment. It supports multimodal input and up to one million tokens of context, but requires NVIDIA Blackwell GPUs and compatible runtimes.

Hugging Face
AI Model2026

Compresses the model by pruning half its experts and quantizing the retained weights, targeting code, agentic workflows, long context, and vision. It retains 94.8%–98.7% of the base model’s scores on two coding benchmarks, at the cost of broader capabilities.

Hugging Face
AI Model2026

A 65B dense language model trained on 12T text and code tokens for reasoning and agentic coding, with context support up to 1M tokens. Its Terminal-Bench 2.1 result stands out, though benchmark scores depend on evaluation setup.