AIAny
AI Infra2025
Icon for item

Zvec

Embeds into an app like SQLite, persisting to a local file with no server or separate process. Combines dense and sparse vectors, full-text search, and scalar filters in one hybrid query; C++ core with Python, Node, Go, Rust, and Dart bindings.

Introduction

Most vector search stacks assume you'll first stand up a separate service — a Milvus deployment, a Qdrant node, a managed cluster — before you can store a single embedding. Zvec rejects that premise: it runs inside your process and persists to a local file the way SQLite does, so the database becomes a library call instead of a network hop. The detail that matters is that this isn't a weekend toy. Its core wraps Proxima, the vector engine Alibaba has run in production for years behind Taobao search, Alipay payments, and Youku.

What Sets It Apart
  • Built on a battle-tested engine rather than a fresh implementation, so retrieval quality and recall behavior come from code already serving billions of queries.
  • Dense vectors, sparse vectors, native full-text search, and scalar filters live in one hybrid query — meaning a single store covers semantic, keyword, and metadata retrieval for RAG without bolting on a separate inverted index.
  • A DiskANN on-disk index keeps datasets larger than RAM queryable, so a laptop or edge device can search corpora that wouldn't fit in memory.
  • Write-ahead logging plus concurrent cross-process reads make it crash-safe and shareable — closer to a real database than an in-memory cache.
Great Fit / Look Elsewhere

Great fit if you're building on-device or single-node RAG, shipping embeddings inside a desktop, mobile, or CLI app, or prototyping retrieval without standing up infrastructure. The same file-backed store works from a server down to a Flutter app. Look elsewhere if you need horizontal sharding across many machines, multi-tenant cluster management, or a hosted control plane — an embedded engine deliberately leaves distributed serving to the heavyweight systems it complements.

Information

  • Websitegithub.com
  • OrganizationsAlibaba Tongyi Lab
  • AuthorsAlibaba
  • Published date2025/12/05

Categories

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.