Lightweight sparse-MoE LLM (7.9B params, ~1.3B activated per token) designed for hybrid multi-step reasoning and agentic tasks. Uses a KDA–MLA hybrid attention stack and a 128-expert sparse FFN; offered in BF16/FP8/INT4 for local and edge deployment.
A customizable 30B-parameter Mixture-of-Experts LLM (3B active) in BF16 for low-latency, high-throughput agent workflows; supports speculative decoding (MTP/DSpark/DFlash) and up to 1M-token contexts. Released with open weights and recipes under OpenMDW-1.1, intended for post-training, domain adaptation, and research on NVIDIA GPU stacks.