Generates and reasons about multimodal physical-world content—text, images, video and action trajectories—conditioned on text, images, video and robot/vehicle action inputs. An edge-sized (4B) Mixture‑of‑Transformers omni-model optimized for single‑GPU inference and Physical AI tasks (image→video, action prediction, robot policy).
Efficient 4B-scale image generation and editing model family that pairs a lightweight VAE tokenizer (Mage-VAE) with a native-resolution multimodal diffusion transformer, reducing tokenization cost by an order of magnitude and enabling few-step high-resolution generation and editing.
Empirically studies how transformer-based native multimodal pre-training scales under fixed compute, deriving compute- and data-allocation power laws and an efficiency frontier for model size, token count, and data mixture; evaluates cross-modal transfer and multimodal in-context learning.
Enables tactile-aware robot manipulation by pretraining a vision–tactile–language–action foundation model and improving offline policies with ALTER. Combines large-scale NeoData visuo-tactile pretraining, a latent tactile pathway for predictive touch signals, and advantage‑conditioned offline RL for contact-rich tasks.
An open-weight LLM focused on deep reasoning, native agentic tool use, and repository-scale code understanding — Mixture-of-Experts architecture with an extended context window and permissive licensing.
Presents a 2.8T-parameter Mixture-of-Experts multimodal model with a 1-million-token context window and 104 billion activated parameters, targeting long-horizon agentic RL, coding, reasoning, and vision. Key innovations include Kimi Delta Attention, Attention Residuals, Stable LatentMoE (16 of 896 experts active per token), ~2.5× scaling efficiency over Kimi K2, and a public weight release.
Real-time streaming multimodal foundation model that uses a codec-native tokenizer (Mage-ViT) to encode motion- and residual-rich regions from video I/P frames, reducing visual token usage by over 75% and enabling up to ~3.5× wall-clock inference speedup after training on ~560M images and 100M video frames.
Generates synchronized stereo audio and video from multimodal inputs (text, images, video, audio), producing 4–15s clips at 24 FPS with a 768p base and an in‑context regeneration path to 2K; supports first/last‑frame and multi‑reference modes and ships as two task‑specific checkpoints.
Provides a 750-billion-parameter multilingual Mixture-of-Experts (MoE) foundation language model optimized for long-context understanding, agentic workflows, and instruction following. Key features include a 262,144-token context window, speculative decoding (MTP/DSpark), 37B active parameters, 10-language support, and an Apache-2.0 license.
Designs and evaluates a foundation GUI agent that performs cross-platform GUI and CLI actions on real devices to complete long-horizon workflows. Emphasizes a unified action space, a large-scale real-device mobile runtime, an AutoResearch-style data flywheel, and online RL training across 10,000+ concurrent environments.
A 35B additive ternary-quantized variant of Mach-1 that aims to preserve most capabilities of its BF16 teacher while reducing compute and memory; shows ~95% mean retention across 12 benchmarks and competitive per-task parity on several evaluations.
Provides a unified multimodal framework for large-scale 3D understanding, text-to-3D generation, and instruction-guided 3D editing. Trains on an 87M-sample 3D multimodal corpus (25M understanding, 50M generation, 12M editing) and pairs a vision-language model with a diffusion-based 3D synthesizer to preserve structure and enable part-aware edits; suited for researchers building text-driven 3D asset pipelines but requires large compute and data.