AIAny
AI Infra2025
Icon for item

OpenRAG

Bundles Langflow, Docling, and OpenSearch into one installable package so you can ingest messy documents, run agentic retrieval with re-ranking, and chat over your own knowledge base. Ships Python/TS SDKs and a built-in MCP server at /mcp.

Introduction

Most RAG demos fall apart the moment they meet real documents — scanned PDFs, nested tables, 300-page reports. The bet here is that the hard part was never the LLM call but everything around it: parsing, indexing, re-ranking, and serving. So Docling (document parsing), OpenSearch (vector + keyword search), and Langflow (visual orchestration) are pre-wired into a single package that runs with one command.

What Sets It Apart
  • Bundled, not glued — instead of a tutorial stitching five services together, the core pieces arrive pre-connected: install and run.
  • Agentic retrieval — multi-agent coordination and re-ranking rather than single-shot vector lookup, so answers hold up on noisy corpora.
  • Docling ingestion — parses messy real-world data (tables, layout, scans) instead of naive text splitting that drops structure.
  • Visual and programmable — a drag-and-drop Langflow builder for fast iteration, plus Python/TypeScript SDKs and a built-in MCP server so assistants like Cursor or Claude Desktop can query your knowledge base directly.
Who It's For

Great fit if you want a self-hosted RAG stack you can stand up quickly and later extend with enterprise add-ons and OpenSearch-scale indexing. Look elsewhere if you need a fully managed SaaS with zero infrastructure, or a lightweight library to embed rather than a full platform — FastAPI + Next.js + OpenSearch is a real footprint to operate and keep running.

Information

  • Websitegithub.com
  • OrganizationsLangflow
  • Authorslangflow-ai
  • Published date2025/07/11

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.