MLOps2023
Framework for unit-testing, evaluating and benchmarking LLM systems with ready-made metrics (G‑Eval, hallucination, task completion), support for local judge models and synthetic datasets, plus CI-friendly integrations for LangChain/OpenAI/Anthropic.
AI API2023
Runnable Jupyter notebooks for building with the Claude API: tool use, RAG, vision, prompt caching, sub-agents, classification, summarization, and integrations like Pinecone and Voyage embeddings. Copy-paste recipes that drop into real projects.
MLOps2024
Runs reproducible evaluations of large language models through a Python API with built-in solvers, scorers, and model-graded grading. Ships 200+ ready-to-run evals spanning capability and safety testing, and connects to most major model providers.
AI Agent2024
Developer framework for building AI agents that autonomously trade on Polymarket prediction markets. Bundles the Polymarket and Gamma APIs, a Chroma RAG layer that pulls in news, and a CLI to query markets, reason with an LLM, and execute trades.
AI Dataset2024
Structured dataset for training and evaluating LLM agentic behavior: function-calling conversations, JSON-mode structured outputs, and extraction samples for teaching models to generate tool calls and strict structured responses. Includes single-turn and multi-turn scenarios across several configs.
AI Agent2024
Framework for building and orchestrating multi-agent LLM systems, with agent types, tool integration, and human-in-the-loop workflows. Supports multi-agent conversation patterns, multiple LLM providers, and RAG-style tooling for research and prototyping agentic workflows.
Companion resources for Chip Huyen's AI Engineering book: chapter summaries, study notes, prompt examples, case studies, and a few analysis scripts. Focuses on engineering practices for adapting foundation models to production rather than step-by-step code tutorials.
AI Client2025
Generates multi-chapter long-form novels with LLMs, automatically linking context and managing foreshadowing for global coherence. Features vector-based retrieval, character/state tracking and a GUI-driven pipeline; requires LLM/embedding API keys.
AI Agent2025
Simulates adversarial attacks against LLMs and AI agents to surface vulnerabilities (e.g., jailbreaks, prompt injection, PII leakage) and ships guardrails to block risky inputs/outputs; runs locally and can be driven from CLI or Python.
AI Others2025
Collects the leaked and reverse-engineered system prompts, internal tool definitions, and model configs of 25+ proprietary AI coding assistants — Cursor, v0, Devin, Replit, Windsurf, Claude Code and more. Reveals what each is told to do.
AI Agent2025
Provides 7×24 automated customer service for the Xianyu marketplace with multi-expert routing, context-aware dialogue, and a laddered bargaining system. Built in Python and designed to run against an LLM provider with browser-cookie integration for web interactions.
AI Others2025
Archive of extracted and leaked system prompts behind major AI chatbots — Claude, ChatGPT, Gemini, Grok, Copilot, Perplexity and more — sorted by vendor and version with update dates, so you can read the hidden instructions and track how they change.