AIAny
Icon for item

Dive into LLMs (《动手学大模型》系列编程实践教程)

Hands-on coding tutorial series for large language models with slides and runnable notebooks covering fine-tuning, prompting, RLHF, safety, steganography, watermarking, multimodal models, GUI agents, and deployment. Community-maintained, free course materials for students and researchers.

Introduction

Practical LLM skills are often scattered across papers, blogs, and vendor docs; this repository consolidates course-grade lectures and runnable notebooks so you can reproduce experiments and learn by doing. It emphasizes short, focused labs that take a concept (e.g., model editing or RLHF) from intuition to a reproducible script.

What Sets It Apart
  • Course-to-code flow: each topic pairs concise slide notes with Jupyter/Colab notebooks and example scripts, so readers can read the idea and immediately run an experiment — useful for teaching or rapid prototyping.
  • Breadth tuned for education: covers a wide slice of modern LLM work (fine-tuning & deployment, prompting and chain-of-thought, knowledge editing, math reasoning, watermarking, jailbreaks, steganography, multimodal models, GUI agents, and safety/RLHF). This breadth makes it a single entry point for course design or capstone projects.
  • Academic + community authorship: originated from Shanghai Jiao Tong University course material and extended by contributors; community updates (including a 2025 addition of a domestically-focused "LM development" series) keep practical content current.
  • Notebook-first, not a production stack: emphasis is on pedagogy and reproducibility of experiments rather than hardened production tooling, so experiments are easy to inspect and modify.
Who It's For & Trade-offs

Great fit if you are a student, instructor, or researcher who wants runnable, course-ready LLM labs that illustrate implementation details behind common methods and safety topics. The repo accelerates learning-by-doing and course preparation.

Look elsewhere if you need production-grade MLOps pipelines, enterprise deployment scaffolding, or highly-optimized inference stacks — this project prioritizes clarity and teachability over production hardening. Also, expect some notebooks to assume familiarity with Python and basic deep-learning tooling.

Where It Fits

Think of this as a teaching-oriented complement to larger resources: it provides hands-on notebooks and slides to accompany theory-focused courses or platform docs. Use it to prototype ideas, design assignments, or learn practical implementation patterns before migrating to production frameworks or platform-specific tooling.

Information

  • Websitegithub.com
  • AuthorsZhang Zhuosheng (张倬胜), Yuan Tongxin (袁童鑫 / Lordog), Ma Xinbei (马欣贝), He Zhiwei (何志威), Du Wei (杜巍), Zhao Haodong (赵皓东), Wu Zongru (吴宗儒), Wu Zheng (吴铮), Dong Lingzhong (董凌众), Zhang Yulong (张玉龙)
  • Published date2024/04/08

More Items

GitHub

Practical, full-stack tutorial for building Retrieval-Augmented Generation (RAG) systems—covers data preprocessing, vector embedding and indexing, hybrid and multimodal retrieval, generation integration, evaluation and production-ready engineering. Includes hands-on projects and examples for developers with Python experience.

GitHub

Provides end-to-end PyTorch scripts to download/prepare data, implement a transformer from scratch, train LLMs (13M→billion-scale) and generate text. Emphasizes educational clarity and single‑GPU experiments; useful for researchers or hobbyists, but large-scale training still requires substantial compute and engineering.

GitHub
AI API2023

Notebooks and sample apps demonstrating generative-AI workflows on Google Cloud's Vertex AI and Gemini — covering RAG grounding, multimodal demos, function calling, and agent-building examples, with deployment-ready templates for evaluation and production.