Tag
Explore by tags
AI Model2026
A sparse MoE base language model for continued training and research, with 280B total parameters and 14B activated per token. Supports up to a 1M-token context for fine-tuning and inference.
A sparse MoE base language model for continued training and research, with 280B total parameters and 14B activated per token. Supports up to a 1M-token context for fine-tuning and inference.