AIAny
AI Infra2024
Icon for item

GraphRAG

Builds a knowledge graph from a text corpus by extracting entities and relations, clusters it into communities with the Leiden algorithm, and summarizes them — so queries can synthesize across scattered documents instead of retrieving isolated chunks.

Introduction

Plain vector RAG quietly fails on a whole class of questions: anything that requires connecting facts scattered across many documents, or summarizing what an entire corpus is "about." Similarity search returns the most relevant chunks, but never the relationships between them. GraphRAG's core move is to do the reasoning work at index time — turning unstructured text into an entity-and-relationship graph, then partitioning that graph into communities and pre-summarizing each one, so a query can reason over structure rather than scrounge for snippets.

What Sets It Apart
  • LLM-extracted knowledge graph: entities, relationships, and claims are pulled from source text, so retrieval traverses connections rather than matching keywords.
  • Hierarchical Leiden communities with bottom-up summaries: the corpus is clustered into nested communities, each summarized in advance, which is what enables corpus-level "sensemaking" answers.
  • Three query modes for different shapes of question: Global Search aggregates community summaries for broad themes, Local Search grounds entity-specific questions in graph context, and DRIFT Search blends the two.
  • On global sensemaking over million-token datasets, the graph approach measurably improves answer comprehensiveness and diversity versus a conventional RAG baseline.
Who It's For and the Trade-offs

Great fit if you need to answer "what are the main themes," "how do X and Y connect," or holistic questions over a large private corpus where chunk-level retrieval falls short. Look elsewhere if your questions are narrow lookups that vector RAG already nails — the indexing pass runs many LLM calls to extract and summarize the graph, so it costs real tokens and time up front. The payoff is in query quality on hard, cross-document questions, not in cheap one-off retrieval.

Information

Categories

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.