AIAny
AI Infra2025
Icon for item

Zvec

Embeds into an app like SQLite, persisting to a local file with no server or separate process. Combines dense and sparse vectors, full-text search, and scalar filters in one hybrid query; C++ core with Python, Node, Go, Rust, and Dart bindings.

Introduction

Most vector search stacks assume you'll first stand up a separate service — a Milvus deployment, a Qdrant node, a managed cluster — before you can store a single embedding. Zvec rejects that premise: it runs inside your process and persists to a local file the way SQLite does, so the database becomes a library call instead of a network hop. The detail that matters is that this isn't a weekend toy. Its core wraps Proxima, the vector engine Alibaba has run in production for years behind Taobao search, Alipay payments, and Youku.

What Sets It Apart
  • Built on a battle-tested engine rather than a fresh implementation, so retrieval quality and recall behavior come from code already serving billions of queries.
  • Dense vectors, sparse vectors, native full-text search, and scalar filters live in one hybrid query — meaning a single store covers semantic, keyword, and metadata retrieval for RAG without bolting on a separate inverted index.
  • A DiskANN on-disk index keeps datasets larger than RAM queryable, so a laptop or edge device can search corpora that wouldn't fit in memory.
  • Write-ahead logging plus concurrent cross-process reads make it crash-safe and shareable — closer to a real database than an in-memory cache.
Great Fit / Look Elsewhere

Great fit if you're building on-device or single-node RAG, shipping embeddings inside a desktop, mobile, or CLI app, or prototyping retrieval without standing up infrastructure. The same file-backed store works from a server down to a Flutter app. Look elsewhere if you need horizontal sharding across many machines, multi-tenant cluster management, or a hosted control plane — an embedded engine deliberately leaves distributed serving to the heavyweight systems it complements.

Information

  • Websitegithub.com
  • OrganizationsAlibaba Tongyi Lab
  • AuthorsAlibaba
  • Published date2025/12/05

Categories

More Items

GitHub
AI Infra2025

Defines a vendor-neutral JSON/YAML semantic model specification and tooling to exchange metrics, dimensions, lineage and other business semantics across analytics, AI and BI platforms; includes a core spec, validators, converters (dbt, GoodData, Salesforce) and example models.

GitHub
AI Train2025

An asynchronous, high-throughput framework for large-scale reinforcement learning and agentic training that scales to 1T+ MoE models and 1000+ GPUs, with native verifiers integration, end-to-end SFT/RL/evals, and Slurm/Kubernetes deployment; requires NVIDIA GPUs.

GitHub

Runs a self-hosted meeting bot and transcription API that joins Google Meet, Teams and Zoom and streams speaker-attributed transcripts in real time. Compiles meetings into a git-backed Markdown workspace and runs sandboxed agents on your infrastructure; Apache-2.0 and air-gap capable.