AIAny
Icon for item

MemPalace

Stores conversation history verbatim and retrieves it via local semantic search with a structured index (wings/rooms/drawers). Pluggable vector backends and a local-first default mean high recall (benchmarked) without cloud or API keys—useful for agent memory and private RAG.

Introduction

Most memory layers either summarize transcripts or move verbatim content to cloud services. MemPalace instead keeps raw conversation text locally and exposes a structured, queryable memory so agents can retrieve exact prior utterances with high recall—96.6% R@5 on LongMemEval for the no-LLM path—while avoiding default cloud exfiltration.

What Sets It Apart
  • Verbatim, structured storage: conversations are stored as drawers inside rooms and wings, letting searches be scoped (person/project/topic) instead of run over a flat corpus, which reduces false positives when retrieving context.
  • Local-first, pluggable backends: ChromaDB is the default; sqlite_exact, qdrant, and pgvector are supported as drop-in backends. The default benchmark path requires no API keys or remote services—so you can reproduce results offline.
  • Reproducible benchmarks and pipelines: included benchmark scripts and a hybrid rerank pipeline (optional LLM reranker) let teams reproduce the 96.6%→≥99% improvement curve without hidden datasets or opaque tuning.
  • MCP ecosystem integration: ships an MCP server and tools to integrate with clients like Claude Code; has auto-save hooks and tooling for mining conversation transcripts into per-message drawers.
Who It's For and Trade-offs

Great fit if you need private, high-recall conversational memory for agents or assistants, want scoped retrieval (per project/person), and prefer reproducible local benchmarks. It’s also practical for teams that want a CLI-first workflow, Docker deployment, and multiple backend options.

Look elsewhere if you require a managed SaaS memory product, need out-of-the-box summary or entity-extraction transforms (MemPalace deliberately stores verbatim text), or cannot allocate the modest disk/CPU cost for a local embedding model and vector store. Note: selecting an external backend (e.g., a remote Qdrant or Postgres with pgvector) will send verbatim drawer text to that service—this is explicit opt-in, not the default.

Information

  • Websitegithub.com
  • AuthorsMemPalace (GitHub organization)
  • Published date2026/04/05

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.