AI Model2026
A multimodal Mixture-of-Experts foundation model with a million-token context window; uses a causal encoder–decoder layout and aggressive KV-cache compression (~890 bytes/token) to limit per-token activation to 8B/16B—designed for long-context, agentic, and multimodal workloads.
AI Model2026
Provides a drop-in checkpoint of DeepSeek-V4.1-Flash with weight-level abliteration that removes safety guardrails to produce uncensored outputs; preserves vision, MoE routing, 1M-token context and native FP8 quantization. Intended for advanced self-hosted deployment; requires large NVLink GPU domains and careful serving setup.
Presents an open 7B dense foundation model for mathematical reasoning and tool-assisted web search, supporting 256K-token context. Key features: hybrid gated sliding-window + global attention for efficient long-context training, FP8 Muon optimizer, progressive 16K→64K→256K curriculum, and open-source weights, data, and recipes.