Teaches generative AI app development through 21 lessons covering LLM basics, prompting, chat, search, image generation, agents, RAG, fine-tuning, small models, and responsible AI.
MLOps2023
Framework for unit-testing, evaluating and benchmarking LLM systems with ready-made metrics (G‑Eval, hallucination, task completion), support for local judge models and synthetic datasets, plus CI-friendly integrations for LangChain/OpenAI/Anthropic.
Chatbot2023
Runs open-weight LLMs (Llama, Gemma, Qwen, GGUF) offline on your machine, with an optional bridge to OpenAI/Anthropic/Mistral. Exposes an OpenAI-compatible API at localhost:1337, so SDK code built for OpenAI switches by changing one base URL.
MCP Server2023
Connects AI coding clients to multiple model providers through MCP, adding multi-model review, planning, debugging, and CLI-to-CLI delegation while keeping the main agent in control.
Awesome LLM Apps is a curated open-source repository collecting awesome LLM applications built with RAG, AI Agents, Multi-agent Teams, MCP, Voice Agents, and more, using models from OpenAI, Anthropic, Gemini, xAI, and open-source alternatives like Qwen or Llama that can run locally.
AI Client2023
Self-hosted browser chat interface for interacting with local or remote LLMs. Supports multiple backends (Ollama, OpenAI-compatible endpoints, llama.cpp), RAG/document chat, plugins/actions, and Docker-based deployment — aimed at teams that need private, customizable LLM UIs.
AI Audio2023
Terminal CLI for on-device Whisper ASR using Hugging Face Transformers + Optimum, with optional Flash Attention 2, batching, and diarization support — focused on high-throughput transcription on NVIDIA GPUs and Apple Silicon (mps).
AI Agent2023
Builds stateful LLM agents whose memory persists across sessions: a tiered, self-editing memory system lets an agent rewrite its own context window so it remembers, learns, and improves over time. Model-agnostic, with Python/TypeScript SDKs.
AI Agent2023
Routes LLM and agent decisions through semantic similarity instead of waiting for full generations, useful for intent routing, tool selection, guardrails, and multimodal handling.
AI Infra2023
Provides a self-hosted inference engine that serves all models an agent needs—embeddings, retrieval/reranking, document-to-markdown OCR, structured extraction, content-safety scoring, and LLM generation—through an OpenAI-compatible API. Bundles a 100+ model catalog, SDKs, and production deployment tooling.
AI Model2023
Multilingual automatic speech recognition and speech-translation model that transcribes and translates audio. Trained on a mix of weakly labeled and pseudo-labeled data (1M + 4M hours), uses 128 Mel bins and adds a Cantonese token, and supports timestamps and long-form chunking for offline ASR and translation.
AI Agent2024
Organizes reusable AI prompts as Markdown 'Patterns' you run from the CLI — summarize a video, extract claims, rate content. Switch among 20+ providers (OpenAI, Claude, Gemini, Ollama) and reach them via CLI, web UI, or REST API.