Self-hosted AI coding assistant you run on your own hardware as an alternative to cloud Copilot. Offers context-aware completion, an in-IDE answer engine and chat, using RAG over your repositories so suggestions match your team's code.
Ensures LLM outputs match precise, schema-defined structures by enforcing Python types, Pydantic models, JSON schemas or grammars at generation time. Provider-agnostic integrations (OpenAI, transformers, vLLM, Ollama, etc.) and function-call style mapping reduce brittle post-processing and make structured generation reliable for production pipelines.
Puts OpenAI-, Anthropic- and Ollama-compatible endpoints in front of 60+ inference backends, so existing client code runs unchanged against local models for text, vision, audio, image and embeddings. Runs CPU-only or accelerated, data stays local.
Runs open-source LLMs entirely on your own laptop or desktop — no GPU, API key, or cloud required. A cross-platform desktop app with LocalDocs, letting you chat privately over your own files; conversations never leave the machine unless you opt in.
Run prompts against OpenAI, Claude, Gemini, and dozens of local or remote models from one terminal command, logging every prompt and response to SQLite. Plugins add new providers, tools, and embeddings; supports schema extraction and function calling.
Streamlines post-training and fine-tuning for large language and multimodal models with a single YAML-driven pipeline. Supports LoRA/QLoRA, full fine-tuning, preference tuning, RL methods, multi-GPU/FSDP/DeepSpeed, and many model backends (Hugging Face, local checkpoints).
Connects a frozen vision encoder to a language model via visual instruction tuning, yielding an open multimodal assistant that follows image-grounded instructions. Released checkpoints span 7B-34B and approach GPT-4V on vision-language benchmarks.
Translates plain-English questions into pandas/SQL code over CSV, Parquet, and SQL databases, returning tables and charts. Combines LLMs with RAG and a semantic layer so non-coders query data; a Docker sandbox isolates generated code.
Self-hosted gateway putting OpenAI, Claude, Gemini, DeepSeek and 20+ providers behind one OpenAI-compatible endpoint. Adds per-token quotas, channel load balancing and usage billing, so teams or resellers meter keys without sharing upstream credentials.
Self-hostable chat UI that connects to any LLM and adds Agents, Web Search, RAG, connectors, code execution and image generation. Ships connectors to 40+ sources and deployment guides for Docker/K8s. Best for teams needing private, extensible chat platforms.
Declarative CLI and library to evaluate and red-team LLM apps: run test cases against prompts and models, compare providers side-by-side, and scan for jailbreaks, prompt injection, and data leaks — with CI/CD and pull-request code scanning built in.
Wraps a local, OpenAI-compatible inference server in one messages API so you can build private AI apps with no data leaving your network: document ingestion, retrieval with inline citations, and built-in tools (web search, code execution, MCP).