Tag

Lightpanda Browser

Provides a minimal, Zig-written headless browser tailored for AI agents and automation — runs JavaScript, supports key Web APIs, exposes the Chrome DevTools Protocol for Puppeteer/Playwright, and targets low memory usage and fast startup for large-scale scraping and agent workflows.

Langflow

Visual canvas for composing, testing, and deploying LLM-based pipelines and multi-agent workflows. Supports major LLMs and vector databases, exports flows as APIs or MCP servers, and offers a desktop bundle for local experimentation and iteration.

vLLM

Open-source LLM inference and serving engine built around PagedAttention, which manages the KV cache like OS virtual memory to cut waste and raise throughput. Supports continuous batching, KV cache sharing, quantization, and an OpenAI-compatible API.

SillyTavern - LLM Frontend for Power Users [Official Homepage]

Locally hosted frontend that connects to many text, image, and TTS backends (KoboldAI, Ooba, Tabby, OpenAI, Claude, OpenRouter, Mistral, NovelAI, Horde). Built around character cards, lorebooks, group chats, and extensions for deep prompt control.

E2B

Runs AI-generated code in secure, isolated cloud sandboxes you control via Python or JavaScript SDKs; supports self-hosting (Terraform) and AWS/GCP, enabling agents and code-interpreting workflows to execute real-world tools safely.

LocalAI

Puts OpenAI-, Anthropic- and Ollama-compatible endpoints in front of 60+ inference backends, so existing client code runs unchanged against local models for text, vision, audio, image and embeddings. Runs CPU-only or accelerated, data stays local.

Flowise

Visually design, test, and ship AI agents and RAG pipelines by wiring nodes that connect LLMs, tools, and vector stores. Every flow becomes an API endpoint or embeddable widget; multi-provider and self-hostable via Docker or cloud.

Axolotl

Streamlines post-training and fine-tuning for large language and multimodal models with a single YAML-driven pipeline. Supports LoRA/QLoRA, full fine-tuning, preference tuning, RL methods, multi-GPU/FSDP/DeepSpeed, and many model backends (Hugging Face, local checkpoints).

One API

Self-hosted gateway putting OpenAI, Claude, Gemini, DeepSeek and 20+ providers behind one OpenAI-compatible endpoint. Adds per-token quotas, channel load balancing and usage billing, so teams or resellers meter keys without sharing upstream credentials.

Onyx

Self-hostable chat UI that connects to any LLM and adds Agents, Web Search, RAG, connectors, code execution and image generation. Ships connectors to 40+ sources and deployment guides for Docker/K8s. Best for teams needing private, extensible chat platforms.

Modular Platform

Provides a unified platform for AI development and deployment, including the MAX serving framework and the Mojo systems programming language for writing kernels. Offers an OpenAI-compatible inference endpoint, Mojo-written CPU/GPU kernels, and tools to run hundreds of open models across diverse hardware without vendor lock-in.

Wraps a local, OpenAI-compatible inference server in one messages API so you can build private AI apps with no data leaving your network: document ingestion, retrieval with inline citations, and built-in tools (web search, code execution, MCP).