AI Model2026
Agentic coding and long-horizon text generation via a 118B-parameter Mixture-of-Experts LLM with a 1,048,576-token context window. Features 256 routed experts, native preserved-thinking (reasoning) control, speculative decoding draft models, and quantized checkpoints for lower-cost serving.
AI Model2026
Generates 2048-d multilingual text embeddings for retrieval and semantic search, suited for RAG and dense retrieval. Pruned and distilled from the Ministral-3 family into a ~1.14B BF16 model, supports long contexts (up to 32,768 tokens) and optimized for NVIDIA GPU inference.
AI Model2026
Open preview checkpoint of a sparse Mixture-of-Experts causal LLM with ~314B total params (~13B active per token) and native 256K context for long-context multilingual text generation. Ships with custom modeling code (trust_remote_code) and a research/non-commercial use license.