AIAny
AI Infra2024
Icon for item

GraphRAG

Builds a knowledge graph from a text corpus by extracting entities and relations, clusters it into communities with the Leiden algorithm, and summarizes them — so queries can synthesize across scattered documents instead of retrieving isolated chunks.

Introduction

Plain vector RAG quietly fails on a whole class of questions: anything that requires connecting facts scattered across many documents, or summarizing what an entire corpus is "about." Similarity search returns the most relevant chunks, but never the relationships between them. GraphRAG's core move is to do the reasoning work at index time — turning unstructured text into an entity-and-relationship graph, then partitioning that graph into communities and pre-summarizing each one, so a query can reason over structure rather than scrounge for snippets.

What Sets It Apart
  • LLM-extracted knowledge graph: entities, relationships, and claims are pulled from source text, so retrieval traverses connections rather than matching keywords.
  • Hierarchical Leiden communities with bottom-up summaries: the corpus is clustered into nested communities, each summarized in advance, which is what enables corpus-level "sensemaking" answers.
  • Three query modes for different shapes of question: Global Search aggregates community summaries for broad themes, Local Search grounds entity-specific questions in graph context, and DRIFT Search blends the two.
  • On global sensemaking over million-token datasets, the graph approach measurably improves answer comprehensiveness and diversity versus a conventional RAG baseline.
Who It's For and the Trade-offs

Great fit if you need to answer "what are the main themes," "how do X and Y connect," or holistic questions over a large private corpus where chunk-level retrieval falls short. Look elsewhere if your questions are narrow lookups that vector RAG already nails — the indexing pass runs many LLM calls to extract and summarize the graph, so it costs real tokens and time up front. The payoff is in query quality on hard, cross-document questions, not in cheap one-off retrieval.

Information

Categories

More Items

GitHub
AI Infra2025

Defines a vendor-neutral JSON/YAML semantic model specification and tooling to exchange metrics, dimensions, lineage and other business semantics across analytics, AI and BI platforms; includes a core spec, validators, converters (dbt, GoodData, Salesforce) and example models.

GitHub
AI Train2025

An asynchronous, high-throughput framework for large-scale reinforcement learning and agentic training that scales to 1T+ MoE models and 1000+ GPUs, with native verifiers integration, end-to-end SFT/RL/evals, and Slurm/Kubernetes deployment; requires NVIDIA GPUs.

GitHub

Runs a self-hosted meeting bot and transcription API that joins Google Meet, Teams and Zoom and streams speaker-attributed transcripts in real time. Compiles meetings into a git-backed Markdown workspace and runs sandboxed agents on your infrastructure; Apache-2.0 and air-gap capable.