AIAny
AI Infra2025
Icon for item

RuVector

Combines a vector store, Cypher-style graph queries, and on-device LLM inference in one Rust engine, with a graph neural network that reranks results and adapts to query patterns in under a millisecond. Services ship as self-contained .rvf containers.

Introduction

Most vector databases are frozen at ingest time: you build the index once, and it never learns from how you actually query it. RuVector inverts that assumption. The index is wrapped in a graph neural network that keeps re-ranking against live query traffic, so retrieval quality drifts toward your real workload instead of staying static. And it keeps vectors, graph relationships, and the model consuming them inside one Rust process, with no Python in the hot path.

What Sets It Apart
  • Self-learning retrieval (SONA architecture with LoRA fine-tuning and GNN re-ranking, claimed sub-millisecond adaptation per query) means relevance tracks your usage without a re-index cycle.
  • One engine replaces a stack: HNSW vector search (sub-100µs per query, 18.9-77.9µs depending on k), Cypher graph queries with hyperedges, and a built-in GGUF inference runtime (ruvllm) instead of bolting a database, a graph store, and an inference server together.
  • The same code targets Node.js, the browser via WASM, PostgreSQL, native Rust, and IoT, so the embedded story and the server story are one binary rather than separate ports.
  • .rvf "cognitive containers" boot a full service in roughly 125ms, which makes cold-start and serverless deployment realistic rather than aspirational.
Who Should Use It

Great fit if you want retrieval that adapts to a live workload, need vector similarity and graph relationships answered in the same query, or want to push AI features to the edge and browser without standing up a separate inference service. Look elsewhere if you need a widely audited, production-hardened store for mission-critical data today: the project is young, effectively single-maintainer, and the headline numbers (sub-millisecond GNN adaptation, 15.7x inference speedup, post-quantum signatures) are largely self-reported rather than independently benchmarked.

Information

  • Websitegithub.com
  • OrganizationsrUv (Reuven Cohen)
  • AuthorsrUv (ruvnet)
  • Published date2025/11/19

More Items

Hugging Face
AI Model2026

Open-weights LLM fine-tuned for phone-based voice agents that prioritizes low latency and reliable tool/function calling. Based on NVIDIA Nemotron 3 Nano (30B total, 3.5B active), supports very long contexts (262,144 tokens) and recommends temperature=0 with thinking disabled for deployment.

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Agent2026

A curated collection of production-ready Agent Skills that turn tasks—presentation production, image generation, local KB retrieval, article assembly, and web-design—into agent-loadable skill folders. Uses a SKILL.md contract, supports multiple agent runtimes (Claude Code, Cursor, Codex), and offers modular install paths with pinned release zips.