Puts OpenAI-, Anthropic- and Ollama-compatible endpoints in front of 60+ inference backends, so existing client code runs unchanged against local models for text, vision, audio, image and embeddings. Runs CPU-only or accelerated, data stays local.
Runs open-source LLMs entirely on your own laptop or desktop — no GPU, API key, or cloud required. A cross-platform desktop app with LocalDocs, letting you chat privately over your own files; conversations never leave the machine unless you opt in.
Pulls context from your whole codebase via Sourcegraph's search API to power chat, autocomplete, and edits across VS Code, JetBrains, and the CLI. Now ships only inside Sourcegraph Enterprise; the free and Pro tiers are retired.
Run prompts against OpenAI, Claude, Gemini, and dozens of local or remote models from one terminal command, logging every prompt and response to SQLite. Plugins add new providers, tools, and embeddings; supports schema extraction and function calling.
Build LLM apps by chaining nodes on a visual canvas — prompts, branching, RAG, agents, tools — and ship the same graph as an API or hosted app. Bundles a plugin marketplace, model routing across hosted and local providers, and built-in observability.
Self-hosted gateway putting OpenAI, Claude, Gemini, DeepSeek and 20+ providers behind one OpenAI-compatible endpoint. Adds per-token quotas, channel load balancing and usage billing, so teams or resellers meter keys without sharing upstream credentials.
Compiles one LLM into device-native binaries running on CUDA, ROCm, Metal, Vulkan, WebGPU, and CPU — same model from server to browser to phone. On Apache TVM, it ships MLCEngine with an OpenAI-compatible API across Python, JS, REST, iOS, and Android.
Notebooks and sample apps demonstrating generative-AI workflows on Google Cloud's Vertex AI and Gemini — covering RAG grounding, multimodal demos, function calling, and agent-building examples, with deployment-ready templates for evaluation and production.
Provides an uncensored, self‑hostable studio for generating AI images, videos, and lip‑synced talking videos in browser or desktop. Integrates 200+ models via Muapi.ai, supports local inference (stable-diffusion.cpp), multi-image inputs and workflow automation — no content filters.
Edits code across an existing repo from the terminal: you describe a change in plain English, it maps the whole codebase, applies edits to the right files, and auto-commits each change as a reviewable git commit. Works with most LLMs.
Tracks, evaluates, and debugs LLM applications with traces, prompt management, datasets, playgrounds, and observability that can run in cloud or self-hosted setups.
Provides a RESTful integration layer that connects WhatsApp and other messaging services to external systems; supports both Baileys (Web) and WhatsApp Cloud API, multiple third-party integrations, media storage, and Docker deployment.