MLOps2023
Framework for unit-testing, evaluating and benchmarking LLM systems with ready-made metrics (G‑Eval, hallucination, task completion), support for local judge models and synthetic datasets, plus CI-friendly integrations for LangChain/OpenAI/Anthropic.
Chatbot2023
Runs open-weight LLMs (Llama, Gemma, Qwen, GGUF) offline on your machine, with an optional bridge to OpenAI/Anthropic/Mistral. Exposes an OpenAI-compatible API at localhost:1337, so SDK code built for OpenAI switches by changing one base URL.
MCP Server2023
Connects AI coding clients to multiple model providers through MCP, adding multi-model review, planning, debugging, and CLI-to-CLI delegation while keeping the main agent in control.
Awesome LLM Apps is a curated open-source repository collecting awesome LLM applications built with RAG, AI Agents, Multi-agent Teams, MCP, Voice Agents, and more, using models from OpenAI, Anthropic, Gemini, xAI, and open-source alternatives like Qwen or Llama that can run locally.
AI Client2023
Self-hosted browser chat interface for interacting with local or remote LLMs. Supports multiple backends (Ollama, OpenAI-compatible endpoints, llama.cpp), RAG/document chat, plugins/actions, and Docker-based deployment — aimed at teams that need private, customizable LLM UIs.
AI Audio2023
Terminal CLI for on-device Whisper ASR using Hugging Face Transformers + Optimum, with optional Flash Attention 2, batching, and diarization support — focused on high-throughput transcription on NVIDIA GPUs and Apple Silicon (mps).
AI Agent2023
Builds stateful LLM agents whose memory persists across sessions: a tiered, self-editing memory system lets an agent rewrite its own context window so it remembers, learns, and improves over time. Model-agnostic, with Python/TypeScript SDKs.
AI Agent2023
Routes LLM and agent decisions through semantic similarity instead of waiting for full generations, useful for intent routing, tool selection, guardrails, and multimodal handling.
AI Agent2024
Organizes reusable AI prompts as Markdown 'Patterns' you run from the CLI — summarize a video, extract claims, rate content. Switch among 20+ providers (OpenAI, Claude, Gemini, Ollama) and reach them via CLI, web UI, or REST API.
AI Client2024
Self-hostable “bookmark everything” app for saving links, notes, images and PDFs with automatic fetching of previews, full-text search, OCR, and LLM-based automatic tagging and summarization (supports local models via ollama). Targets users who want AI-assisted organization in a self-hosted stack.
AI API2024
Build AI workflows once and run them across model providers — GoogleAI, OpenAI, Claude, Ollama — through one SDK. Composable primitives for RAG, tool use, and agents, plus a local dev UI for tracing and debugging, with SDKs in JS/TS, Go, and Python.
AI API2024
aisuite is a lightweight Python library that provides a unified API for working with multiple Generative AI providers. It supports models from OpenAI, Anthropic, Google, Hugging Face, AWS, Cohere, Mistral, Ollama, and others—abstracting away SDK differences, authentication details, and parameter variations. Modeled after OpenAI’s API style, it enables developers to build LLM-based or agentic applications across providers with minimal setup.