Unifies continuous streaming perception, full‑duplex real‑time interaction, and agentic tool use across video, audio, and text. Proposes a Cerebellum–Brain split—streaming Thinker‑Talker cerebellum for low‑latency interaction plus a Brain for complex reasoning—and is released with models, code, and data.
Multimodal agentic model for long-horizon computer and browser tasks, with visual self-correction and function-calling. The Pro variant is a 397B Mixture-of-Experts (≈17B active) model with a 262,144-token context window, Docker deployment recipes, and weights currently marked “coming soon.”
Adds a Next Concept Prediction objective that predicts discrete, product-quantized latent concepts spanning multiple tokens alongside next-token prediction, yielding faster pretraining convergence and measurable downstream gains with an 8.9B-parameter latent-space LLM.
Open-weights preview checkpoint for a multimodal reasoning model that generates text from text and image/video inputs, exposes adjustable reasoning effort and tool-calling, and supports an extended 262,144-token context for long-horizon tasks and agent-style workflows.