Category

Pathway

Unified Python framework where the same code runs on batch and streaming data, backed by a Rust engine on Differential Dataflow for incremental computation. Aimed at ETL, analytics, and live RAG pipelines over Kafka and 300+ connectors.

AstrBot

Connects one LLM agent to 15+ chat platforms — QQ, WeChat Work, Feishu, Telegram, Discord, Slack — from a single self-hosted backend. Routes to OpenAI, Anthropic, Gemini, DeepSeek or Ollama, and adds a WebUI, MCP tools, and a 1000+ plugin marketplace.

DSPy

Lets you write compositional Python programs that compile into self‑improving LLM pipelines — replacing brittle prompt engineering with a declarative, programmatic approach and built‑in algorithms to optimize prompts and weights for RAG, multi‑stage pipelines, and agent loops.

OpenRouter

Routes one API call across hundreds of LLMs from dozens of providers, with credits, fallbacks, pricing comparison, and data-policy controls for teams that need model choice without wiring every provider separately.

DocsGPT

Turns documents, web pages and audio into a private, searchable knowledge base and builder for AI assistants and agents — supports wide-format ingestion, multi-model (cloud or local) execution, retrieval-augmented responses, and enterprise deployment features like RBAC and SSO.

Aggregates alerts from dozens of monitoring tools into a single pane of glass, then deduplicates, correlates, and enriches them. Automates incident response with declarative YAML workflows — like GitHub Actions for your monitoring stack.

Lightpanda Browser

Provides a minimal, Zig-written headless browser tailored for AI agents and automation — runs JavaScript, supports key Web APIs, exposes the Chrome DevTools Protocol for Puppeteer/Playwright, and targets low memory usage and fast startup for large-scale scraping and agent workflows.

vLLM

Open-source LLM inference and serving engine built around PagedAttention, which manages the KV cache like OS virtual memory to cut waste and raise throughput. Supports continuous batching, KV cache sharing, quantization, and an OpenAI-compatible API.

faster-whisper

Reimplements OpenAI's Whisper speech-to-text on the CTranslate2 inference engine, running up to 4x faster at the same accuracy while using less memory. Adds a batched pipeline, 8-bit quantization, VAD filtering, and word-level timestamps.

E2B

Runs AI-generated code in secure, isolated cloud sandboxes you control via Python or JavaScript SDKs; supports self-hosting (Terraform) and AWS/GCP, enabling agents and code-interpreting workflows to execute real-world tools safely.

llama.cpp

Runs large language models entirely in C/C++ with no external dependencies, using 1.5-to-8-bit integer quantization and CPU+GPU hybrid inference to fit models larger than available VRAM. Backs Ollama, LM Studio, and most local-inference tooling.

RAGFlow

Builds production RAG systems around deep document understanding, explainable chunking, hybrid retrieval, citations, and agent workflows for messy enterprise documents.