An open, intuition-first textbook that teaches the maths, computing, and practical foundations needed for AI engineering. Organized into focused chapters (vectors, matrices, calculus, ML, NLP, CV, GPU/Inference, ML systems) with code-first explanations and interview-ready emphasis.
Frames AI research as a trainable practice of reading, building, debugging, and fast feedback. The essay is most useful for researchers learning how to avoid hype-chasing, benchmark tunnel vision, and agent-induced blind spots.
Provides a systematic benchmark and design roadmap for video-based world models to evaluate robot policies, introducing WMBench and GigaWorld-1 optimized for long-horizon, action-faithful rollouts. Offers controlled comparisons across model families, action encodings, and 324k+ simulated vs real rollouts, with code, models, and datasets released for reproducible evaluation.
Accepts text, image and audio inputs and generates text outputs for conversational, instruction-following and multimodal tasks; a sparse-MoE autoregressive model (975B total, 41B active) with BF16/NVFP4 support and local-deploy recipes.
Enables efficient, generalist video understanding by combining an Inflated 3D Vision Transformer and adaptive frame-resolution streaming with a scalable video data synthesis pipeline; ships as a fully open 4B-parameter MLLM that improves general, long-form, and streaming benchmarks.
Generates synchronized audiovisual output from text, image, or audio prompts — a diffusion-based multimodal model with componentized weights (video/audio VAEs, multilingual text encoder, distilled transformer) and ready integration with HuggingFace pipelines and ComfyUI.
Presents Metis, a prototype memory foundation model that embeds a persistent native memory state into the backbone so historical experience is compressed and accessed via memory attention. Key features: forward-only, gradient-free online memory updates; memory-specific mid-training objectives; and a dual text/code memory design.
Autonomous multimodal GUI agent that executes natural-language interface tasks across mobile apps, web domains, and desktop OS. Expands environment coverage (170+ multilingual apps, 4,000+ web domains), uses function-grounded task generation and keypoint-based multi-model verification to produce reliable RL rewards for real-world deployment.
Provides a unified, camera-conditioned, multi-source video dataset and reproducible processing pipeline for training long-horizon video world models. Key features: a canonical frame-aligned contract (visuals, camera geometry, captions, quality metadata), 1.43M canonical clips with portable releases and reconstruction tools; large download and some backbone assets carry separate licenses.
Provides an end-to-end, reproducible foundation for camera‑controllable, long‑horizon video world models — converting 1.43M clips from 10 datasets into a unified canonical corpus and releasing data, pipelines, recipes, and weights. Introduces backbone‑native adaptation and a three‑stage training recipe to produce 5B–33B models that enable minute‑to‑hour rollouts after training on 5s sequences.