AIAny
AI Infra2025
Icon for item

RAG-Anything

Extends RAG beyond text: parses PDFs and Office files containing images, tables, equations, and charts, then queries them through one multimodal knowledge graph. Built on LightRAG, it replaces separate parsing and retrieval tools.

Introduction

Most RAG stacks quietly throw away half of every document. The moment a PDF holds a chart, a results table, or a LaTeX equation, a text-only retriever either skips it or flattens it into a meaningless string — yet that is often exactly where the answer lives. The bet here is that multimodal content deserves first-class treatment inside the knowledge graph, not a bolt-on caption.

What Sets It Apart
  • Built directly on LightRAG, so it inherits graph-based retrieval but adds parallel channels for images, tables, and formulas — a query can traverse from a paragraph to the chart that actually supports it.
  • A five-stage pipeline (parse → analyze → build graph → retrieve → rank) where parsing is pluggable: MinerU, Docling, or PaddleOCR. You pick the parser that copes with your document quirks instead of being locked into one.
  • Retrieval fuses vector similarity with graph traversal, then re-ranks by modality, so a question about a number returns the relevant table cell rather than the prose around it.
Who It's For

Great fit if you index research papers, technical manuals, or enterprise reports where tables and figures carry the real signal, and you want one framework instead of a dozen glued-together tools. Look elsewhere if your corpus is plain prose — the multimodal graph and parser overhead buy you little — or if you need a turnkey hosted service rather than a Python framework you assemble and run yourself.

Information

  • Websitegithub.com
  • OrganizationsData Intelligence Lab, University of Hong Kong
  • AuthorsZirui Guo, Xubin Ren, Lingrui Xu, Jiahao Zhang, Chao Huang
  • Published date2025/06/06

Categories

More Items

GitHub

Turns natural-language instructions into end-to-end Android automation that drives real devices and captures Logcat and screenshots. Uses a multimodal “Dynamic‑First, Coordinate‑Fallback” locator and a native MCP server for IDE integration, supporting fast Flash (3–5s/step) and verifiable Pro workflows.

Converts real repositories into verifiable, sandboxed training environments with black-box tests to train coding agents on long-horizon program reproduction. Provides Program-Env for automated environment construction and Program-Agent for a role-isolated development workflow, yielding 1,648 C/C++/Go/Rust tasks and improving benchmark performance.

GitHub
AI Agent2026

Runs a local-first AI agent runtime that drives your desktop and automates workflows — browsing, file edits, approved shell commands, document extraction, and scheduled tasks — while integrating local or cloud LLMs (llama.cpp/TurboQuant) and embedding as an HTTP service or Tauri sidecar.