Self-hostable chat client that unifies many LLM providers (OpenAI, Claude, Gemini, Ollama, DeepSeek) behind one UI. Adds file-upload knowledge-base RAG, vision/TTS, an MCP plugin system, and an agent marketplace, with one-click Vercel or Docker deployment.
Unifies access to OpenAI, Anthropic, Google and other LLM providers behind one TypeScript API — swap models by changing a string. Adds streaming UI hooks for React, Next.js, Svelte and Vue, plus a tool-calling loop for agentic workflows.
Teaches generative AI app development through 21 lessons covering LLM basics, prompting, chat, search, image generation, agents, RAG, fine-tuning, small models, and responsible AI.
Framework for unit-testing, evaluating and benchmarking LLM systems with ready-made metrics (G‑Eval, hallucination, task completion), support for local judge models and synthetic datasets, plus CI-friendly integrations for LangChain/OpenAI/Anthropic.
Runs open-weight LLMs (Llama, Gemma, Qwen, GGUF) offline on your machine, with an optional bridge to OpenAI/Anthropic/Mistral. Exposes an OpenAI-compatible API at localhost:1337, so SDK code built for OpenAI switches by changing one base URL.
Connects AI coding clients to multiple model providers through MCP, adding multi-model review, planning, debugging, and CLI-to-CLI delegation while keeping the main agent in control.
Awesome LLM Apps is a curated open-source repository collecting awesome LLM applications built with RAG, AI Agents, Multi-agent Teams, MCP, Voice Agents, and more, using models from OpenAI, Anthropic, Gemini, xAI, and open-source alternatives like Qwen or Llama that can run locally.
Self-hosted browser chat interface for interacting with local or remote LLMs. Supports multiple backends (Ollama, OpenAI-compatible endpoints, llama.cpp), RAG/document chat, plugins/actions, and Docker-based deployment — aimed at teams that need private, customizable LLM UIs.
Terminal CLI for on-device Whisper ASR using Hugging Face Transformers + Optimum, with optional Flash Attention 2, batching, and diarization support — focused on high-throughput transcription on NVIDIA GPUs and Apple Silicon (mps).
Builds stateful LLM agents whose memory persists across sessions: a tiered, self-editing memory system lets an agent rewrite its own context window so it remembers, learns, and improves over time. Model-agnostic, with Python/TypeScript SDKs.
Routes LLM and agent decisions through semantic similarity instead of waiting for full generations, useful for intent routing, tool selection, guardrails, and multimodal handling.
Provides a self-hosted inference engine that serves all models an agent needs—embeddings, retrieval/reranking, document-to-markdown OCR, structured extraction, content-safety scoring, and LLM generation—through an OpenAI-compatible API. Bundles a 100+ model catalog, SDKs, and production deployment tooling.