Run prompts against OpenAI, Claude, Gemini, and dozens of local or remote models from one terminal command, logging every prompt and response to SQLite. Plugins add new providers, tools, and embeddings; supports schema extraction and function calling.
Open platform for training, serving, and evaluating LLM chatbots; ships a distributed multi-model serving system with OpenAI-compatible APIs. Release home of Vicuna and Chatbot Arena, whose 1.5M+ human votes power an Elo leaderboard across 70+ models.
Build LLM apps by chaining nodes on a visual canvas — prompts, branching, RAG, agents, tools — and ship the same graph as an API or hosted app. Bundles a plugin marketplace, model routing across hosted and local providers, and built-in observability.
Declarative CLI and library to evaluate and red-team LLM apps: run test cases against prompts and models, compare providers side-by-side, and scan for jailbreaks, prompt injection, and data leaks — with CI/CD and pull-request code scanning built in.
Notebooks and sample apps demonstrating generative-AI workflows on Google Cloud's Vertex AI and Gemini — covering RAG grounding, multimodal demos, function calling, and agent-building examples, with deployment-ready templates for evaluation and production.
Tracks, evaluates, and debugs LLM applications with traces, prompt management, datasets, playgrounds, and observability that can run in cloud or self-hosted setups.
Runs LLM-generated Python in a Rust sandbox that starts in tens of microseconds (~60µs), with no container overhead. Filesystem, network, and environment access are blocked, and state serializes for pause/resume with per-run resource limits.
Open-source AI coding assistant for VS Code and JetBrains that bundles autocomplete, chat, inline edit, and an agent mode behind one config, letting each capability use any model provider rather than a single locked-in vendor.
Chat with your documents via retrieval-augmented generation; each answer carries inline citations and a built-in viewer highlights the cited PDF passage. Pairs full-text with vector search and runs on OpenAI, Azure, Cohere, Ollama, or local models.
Self-hostable platform for building enterprise GenAI apps with visual workflow orchestration — loops, parallelism, human-in-the-loop — plus RAG, agents, unified model management, and in-house OCR for handwriting and rare characters.
Connects AI coding clients to multiple model providers through MCP, adding multi-model review, planning, debugging, and CLI-to-CLI delegation while keeping the main agent in control.