Lets canvas-native agents plan, generate, edit, and organize long-horizon multimodal creative projects by representing artifacts, versions, and actions as typed canvas nodes and links. Uses a three-layer design (canvas state, protocol bridge, agent runtime) so agents act within an inspectable, editable project state.
Generates text from text, image, or audio inputs using a native multimodal, Mixture-of-Experts autoregressive transformer (276B total / 12B active) with up to 1M-token context; targeted at conversational, agentic, coding and multimodal applications.
Open-weight multimodal Mixture-of-Experts LLM with native vision and a 1,048,576-token context window. 2.8T parameters (104B activated), MXFP4 quantization, released for agentic long-horizon coding, knowledge work, and vision-in-the-loop workflows.
Presents a 2.8T-parameter Mixture-of-Experts multimodal model with a 1-million-token context window and 104 billion activated parameters, targeting long-horizon agentic RL, coding, reasoning, and vision. Key innovations include Kimi Delta Attention, Attention Residuals, Stable LatentMoE (16 of 896 experts active per token), ~2.5× scaling efficiency over Kimi K2, and a public weight release.
GGUF-quantized build of Moonshot AI's Kimi K3 for local inference: MXFP4-aware quantization, image-text-to-text pipeline support, native vision and a 1,048,576-token context window. Intended for local GGUF runtimes (vLLM, SGLang, TokenSpeed) with Kimi K3 license constraints.
Real-time streaming multimodal foundation model that uses a codec-native tokenizer (Mage-ViT) to encode motion- and residual-rich regions from video I/P frames, reducing visual token usage by over 75% and enabling up to ~3.5× wall-clock inference speedup after training on ~560M images and 100M video frames.
Generates synchronized stereo audio and video from multimodal inputs (text, images, video, audio), producing 4–15s clips at 24 FPS with a 768p base and an in‑context regeneration path to 2K; supports first/last‑frame and multi‑reference modes and ships as two task‑specific checkpoints.
Evaluates multimodal context learning across grounding, new information application, and knowledge acquisition using a 3,443-instance benchmark spanning science, finance, long documents, spatial reasoning, and web VQA; finds current multimodal models perform poorly (best score 0.2847) and analyzes failure modes.
Recovers editable design files from raster images by growing an editable layer hierarchy via an agentic pipeline that selects and composes modality-specific tools. Introduces graceful verification (accept/prune/retry) to prevent error accumulation and presents the Figma Edit Replay Benchmark (909 files, 14,796 edits) to measure editability across layout, color, and text edits.
Captures synchronized multimodal embodied-human data in real homes — egocentric and multi-view video, metric body/hand/object motion, audio, and tactile signals. Released under a gated non-commercial research license with identifiable participants and strict non-redistribution/privacy constraints.
Presents Metis, a prototype memory foundation model that embeds a persistent native memory state into the backbone so historical experience is compressed and accessed via memory attention. Key features: forward-only, gradient-free online memory updates; memory-specific mid-training objectives; and a dual text/code memory design.
Directly maps visual observations and language instructions to continuous robot actions, replacing LLM-centric V→L→A pipelines. Uses separate visual and language encoders with lightweight bidirectional interaction and a compact decoder to cut inference cost and VRAM, achieving ~31 ms latency and <1 GB VRAM on an RTX 4090; suited for real-time robotic manipulation under tight compute budgets.