A sparse-MoE multimodal LLM fine-tuned with large-scale mixed reinforcement learning, supporting text/image/video/audio and a 1M-token context window; designed for long-horizon agentic tasks, coding and visual reasoning with groupwise grading and on-policy distillation.
Open-weights multimodal LLM checkpoint designed for 1M-token long-context agent runs that combines large-scale on-policy RL with groupwise grading for iterative self-improvement. Key traits: sparse MoE backbone (≈1.02T total / 42B active), text-only output with image/video/audio inputs, MIT-licensed weights on HuggingFace—suited for long-horizon agents and research at significant infra cost.