AIAny
Icon for item

QMD - Query Markup Documents

On-device search engine for notes, transcripts, and code that blends BM25 full-text, vector semantic search, and a local LLM re-rank — all running offline via node-llama-cpp and SQLite. Ships an MCP server so AI agents can query your knowledge base.

Introduction

Most tools that promise "AI search over your notes" quietly ship those notes to a cloud API. This one takes the opposite bet: keyword ranking, embeddings, and the final LLM re-rank all run on your own machine, so a private corpus never leaves the device. The interesting claim is that good hybrid retrieval no longer needs a server behind it.

What Sets It Apart
  • Three-stage retrieval, not one trick. BM25 catches exact terms, vector search (default EmbeddingGemma-300M, swappable for multilingual models like Qwen3-Embedding) catches meaning, and a local LLM re-ranks the survivors — so a vague query like "the meeting where we cut the budget" can still land.
  • Genuinely offline. Everything runs through node-llama-cpp with GGUF models on top of SQLite (FTS5 + sqlite-vec): no API keys, no network round-trips, no per-token billing.
  • Built for agents, not just humans. Beyond the CLI it exposes an MCP server and emits JSON, CSV, Markdown, and XML, so coding agents and scripts can treat your notes as a queryable tool.
  • Content-aware chunking. Prose is split into overlapping windows (~900 tokens, 15% overlap) while code is chunked along its AST, so retrieved fragments stay coherent instead of being cut mid-function.
Who It's For

Great fit if you keep a large, private corpus — markdown notes, meeting transcripts, a codebase — and want agent-ready retrieval without handing any of it to a third party. Look elsewhere if you need hosted multi-user team search or zero local setup: it expects you to run models locally, and indexing a big corpus on-device costs CPU, RAM, and time up front.

Information

  • Websitegithub.com
  • OrganizationsIndependent
  • Authorstobi
  • Published date2025/12/08

More Items

GitHub
AI Client2024

Unifies visual creator tools, reusable Skills, and a Codex-powered Agent to handle video translation, image/video generation, voiceovers, and editing in one local multimodal workspace. Desktop and web clients share a synchronized state machine and keep data local by default.

GitHub
AI Client2025

Private, local-first desktop assistant for voice and text conversations that runs models on your hardware. Uses local model servers (Ollama or OpenAI-compatible endpoints), offers personal memory, dictation, TTS/STT, MCP integrations and automatic redaction; free for personal use.

GitHub

Turns natural-language instructions into end-to-end Android automation that drives real devices and captures Logcat and screenshots. Uses a multimodal “Dynamic‑First, Coordinate‑Fallback” locator and a native MCP server for IDE integration, supporting fast Flash (3–5s/step) and verifiable Pro workflows.