Frames AI research as a trainable practice of reading, building, debugging, and fast feedback. The essay is most useful for researchers learning how to avoid hype-chasing, benchmark tunnel vision, and agent-induced blind spots.
Provides a systematic benchmark and design roadmap for video-based world models to evaluate robot policies, introducing WMBench and GigaWorld-1 optimized for long-horizon, action-faithful rollouts. Offers controlled comparisons across model families, action encodings, and 324k+ simulated vs real rollouts, with code, models, and datasets released for reproducible evaluation.
Accepts text, image and audio inputs and generates text outputs for conversational, instruction-following and multimodal tasks; a sparse-MoE autoregressive model (975B total, 41B active) with BF16/NVFP4 support and local-deploy recipes.
Enables efficient, generalist video understanding by combining an Inflated 3D Vision Transformer and adaptive frame-resolution streaming with a scalable video data synthesis pipeline; ships as a fully open 4B-parameter MLLM that improves general, long-form, and streaming benchmarks.
Generates synchronized audiovisual output from text, image, or audio prompts — a diffusion-based multimodal model with componentized weights (video/audio VAEs, multilingual text encoder, distilled transformer) and ready integration with HuggingFace pipelines and ComfyUI.
Presents Metis, a prototype memory foundation model that embeds a persistent native memory state into the backbone so historical experience is compressed and accessed via memory attention. Key features: forward-only, gradient-free online memory updates; memory-specific mid-training objectives; and a dual text/code memory design.