AIAny
AI Model2026
Icon for item

MiMo-V2.6-Flash-RL

A sparse-MoE multimodal LLM fine-tuned with large-scale mixed reinforcement learning, supporting text/image/video/audio and a 1M-token context window; designed for long-horizon agentic tasks, coding and visual reasoning with groupwise grading and on-policy distillation.

Introduction

Why this matters

MiMo-V2.6-Flash-RL targets a practical research axis: scaling reinforcement-learning compute, task diversity and grader capacity together so a single multimodal model can continuously improve across long-horizon, multi-agent tasks. Instead of separate per-domain RL runs, Flash runs mixed RL at very large batch sizes and uses groupwise grading and on-policy distillation to produce measurable capability gains without per-task isolation.

Key Capabilities
  • Mixed RL at scale: Trained with fully asynchronous Group Relative Policy Optimization on very large hybrid batches (example training steps use 1,568 prompts × 16 rollouts), producing dense, comparative rewards that prioritize higher-quality passing rollouts.
  • Sparse MoE multimodal backbone: 309B total / ~15B active parameters, hybrid Sliding Window + Global attention, native support for text, image, video and audio, and an extreme 1M-token context length for long-repository, multi-session and tool-driven traces.
  • Agentic grading and distillation: Groupwise Reward Synthesis (GRS) and Groupwise Advantage Redistribution (GAR) form a closed self-improvement loop; Multi-Prefix Multi-Teacher On-Policy Distillation (MOPD2) transfers dense, token-level teacher signals into the student without regenerating long histories.
  • Practical inference features: 5-layer Multi-Token Prediction (MTP) speculative decoder, FP8 support recommendations, and SGLang/vLLM deployment recipes to reduce rollout costs and accelerate agentic workflows.
Who it fits and trade-offs

Great fit if you are building or researching long-horizon multimodal agents, RL-driven capability scaling, or code/visual agent pipelines and have access to large compute or distributed inference stacks. It provides a research-ready checkpoint and accompanying RL environments and harnesses for reproducing or extending large mixed-RL experiments.

Look elsewhere if you need a lightweight model for edge devices or simple single-turn chat: Flash requires specialized sparse-MoE inference infrastructure, significant GPU resources for fine-tuning or serving at scale, and careful safety/hardening when used for security-related tasks. Its strengths come with higher deployment complexity and compute costs compared with compact dense models.

Quick positioning

MiMo-V2.6-Flash-RL is positioned as an open checkpoint for community RL and agent research: it emphasizes mixed-domain RL, comparative grading, and distillation to make large, multimodal, long-context models improve autonomously. Use it for experiments that need long contexts, multimodal perception, and agentic evaluation loops; prefer smaller/dense alternatives for constrained-production or low-latency use cases.

Information

  • Websitehuggingface.co
  • OrganizationsXiaomi MiMo Team, Xiaomi Corporation
  • Published date2026/09/21

Categories

More Items

Hugging Face
AI Model2026

A 9B agentic multimodal SFT checkpoint distilled from Qwen3.5-9B for coding, general agent tasks, visual coding and cybersecurity. Provided by Xiaomi MiMo as a research seed (77.4B-token SFT mix) to bootstrap agentic RL and tool-use experiments.

Hugging Face
AI Model2026

A pretrained autoregressive foundation LLM from Yandex that uses a hybrid MoE design (80B params, 3B active) and supports up to 262,144-token context. Notably strong on Russian factual knowledge, math and coding benchmarks; intended for research and fine-tuning rather than out-of-the-box production.

Hugging Face
AI Model2026

Open-weights multimodal LLM checkpoint designed for 1M-token long-context agent runs that combines large-scale on-policy RL with groupwise grading for iterative self-improvement. Key traits: sparse MoE backbone (≈1.02T total / 42B active), text-only output with image/video/audio inputs, MIT-licensed weights on HuggingFace—suited for long-horizon agents and research at significant infra cost.