A MoE causal large language model for long-horizon agents, coding, and multi-step reasoning: 2.4T parameters (95B activated), native 262,144-token context (extensible to 1,010,000), multi-token prediction, and configurable thinking-mode reasoning controls.
FP8-quantized checkpoint of the Qwen3.8 text-only causal LLM (2.4T params, 95B activated) for text-generation; preserves near-original performance, supports very long contexts (262k–1M), Mixture-of-Experts architecture, and is compatible with vLLM/SGLang/TokenSpeed. Thinking mode and preserve_thinking are enabled by default.