Open preview checkpoint of a sparse Mixture-of-Experts causal LLM with ~314B total params (~13B active per token) and native 256K context for long-context multilingual text generation. Ships with custom modeling code (trust_remote_code) and a research/non-commercial use license.