A GitHub repository of learning notes and code dedicated to ML + SYS (machine learning systems). It collects tutorials, code walkthroughs and engineering notes on RLHF, distributed training (FSDP, Megatron), inference and scheduling (SGLang, vllm), quantization, CUDA/GPU optimization, system design, and practical engineering.
AI Agent2024
Framework for building and orchestrating multi-agent LLM systems, with agent types, tool integration, and human-in-the-loop workflows. Supports multi-agent conversation patterns, multiple LLM providers, and RAG-style tooling for research and prototyping agentic workflows.
AI Client2024
Translates scientific PDFs while keeping the original layout intact: parses text, tables, and figures, then re-renders bilingual or monolingual output via any OpenAI-compatible LLM. Tuned for English-to-Chinese papers, with CSV glossary support.
AI Client2024
Converts PDF, Office docs, EPUB, images, audio, HTML and ZIP archives into structured Markdown for LLM pipelines, preserving headings, tables and links instead of visual layout. Adds optional OCR, audio transcription and LLM image captions.
AI Agent2024
Orchestrates configurable deep-research agent workflows that combine LLMs, web search, and MCP tools to produce structured research reports and evaluation outputs. Supports LangGraph Studio, multiple model providers (OpenAI, Anthropic, local models), and Deep Research Bench evaluation for benchmarked comparisons.
AI Client2024
Brings an agentic chat experience to the terminal: describe a task in natural language and it plans, edits files, and runs commands to build the app. Written in Rust, ships on macOS and Linux. Now succeeded by the closed-source Kiro CLI.
AI Client2024
A self-hostable virtual companion: a VRM or Live2D character you own that voice-chats in real time, plays Minecraft and Factorio, and runs models in-browser via WebGPU or across 25+ LLM providers like Ollama, OpenAI, and Claude.
AI Client2024
Generates structured, streaming UIs from LLM output and renders them in React using a compact OpenUI Lang, built component libraries, and chat surfaces; claims up to ~67% token savings vs JSON and includes a playground and CLI.
Companion resources for Chip Huyen's AI Engineering book: chapter summaries, study notes, prompt examples, case studies, and a few analysis scripts. Focuses on engineering practices for adapting foundation models to production rather than step-by-step code tutorials.
AI Client2024
Runs iterative, fully-local web research loops using locally hosted LLMs (via Ollama or LMStudio): it auto-generates search queries, gathers and summarizes results, reflects to find gaps, re-queries, and emits a final markdown report with sources.
AI Agent2024
A library of specialized AI agents that automate data science steps: loading, cleaning, wrangling, feature engineering, SQL queries, EDA, and ML modeling via H2O and MLflow. Higher-level analyst workflows chain these under a supervisor agent.