AI Agent Papers2024
Treats the interface between an LM agent and a computer as a design variable. A custom agent-computer interface (ACI) with concise file-edit, repo-navigation, and test commands plus compact feedback reaches 12.5% pass@1 on SWE-bench, 87.7% on HumanEvalFix.
AI Infra2010
The N-dimensional array (ndarray) underpinning Python's scientific stack — pandas, scikit-learn, and SciPy build directly on it. Vectorized math, broadcasting, and a C/Fortran bridge move numeric work out of Python loops into compiled code.
Chops any layer-sequence model across accelerators and splits each mini-batch into micro-batches to keep the pipeline busy, hitting near-linear speedup without architecture-specific tricks or fast interconnects.
AI Infra2021
Drop-in transformer building blocks with custom CUDA kernels: memory-efficient exact attention (up to ~10x faster), block-sparse attention, fused softmax/layernorm/SwiGLU ops. Cuts VRAM and speeds up diffusion and LLM training on Nvidia GPUs.
AI Infra2022
Fused CUDA kernels that compute exact attention without ever writing the full N×N score matrix to GPU memory, cutting memory from quadratic to linear and speeding up training and inference on A100/H100. Ships FlashAttention-2/3 plus KV-cache decode paths.
AI Infra2022
Unified Python framework where the same code runs on batch and streaming data, backed by a Rust engine on Differential Dataflow for incremental computation. Aimed at ETL, analytics, and live RAG pipelines over Kafka and 300+ connectors.
AI Train2023
Modular PyTorch-based framework for building, training, and deploying physics-informed ML models (neural operators, PINNs, GNNs, diffusion). Provides GPU‑optimized training, domain-specific datapipes for meshes/point clouds, distributed scaling and a model zoo.
AI Infra2023
Tracks, evaluates, and debugs LLM applications with traces, prompt management, datasets, playgrounds, and observability that can run in cloud or self-hosted setups.
AI Infra2024
Runs AI-generated code in isolated, elastic sandboxes with SDK, API, and CLI access for agent workflows that need stateful execution and environment control.
AI Infra2024
A minimal GPU written in under 15 SystemVerilog files to teach how GPUs execute parallel kernels from the ground up. Includes an 11-instruction ISA, multiple cores with ALUs and load-store units, a fetch-decode-execute pipeline, and matrix kernels.
A GitHub repository of learning notes and code dedicated to ML + SYS (machine learning systems). It collects tutorials, code walkthroughs and engineering notes on RLHF, distributed training (FSDP, Megatron), inference and scheduling (SGLang, vllm), quantization, CUDA/GPU optimization, system design, and practical engineering.
Companion resources for Chip Huyen's AI Engineering book: chapter summaries, study notes, prompt examples, case studies, and a few analysis scripts. Focuses on engineering practices for adapting foundation models to production rather than step-by-step code tutorials.