AI Infra2025
Bundles Langflow, Docling, and OpenSearch into one installable package so you can ingest messy documents, run agentic retrieval with re-ranking, and chat over your own knowledge base. Ships Python/TS SDKs and a built-in MCP server at /mcp.
AI Infra2025
An open-source memory layer that turns agent runs and conversations into structured, persistent state recallable across sessions. Captures facts, events, preferences, and relationships automatically; LLM-agnostic with SDK and MCP integration.
AI Agent2025
Compiles an agent's raw chat logs, documents, and tool traces into three persistent layers — index, learned skills, and user memory — so context survives sessions. Claims 92% Locomo-benchmark accuracy and up to 95% lower token cost than replaying history.
AI Infra2025
Lets AI coding agents provision and operate a full backend themselves — Postgres with pgvector, OAuth2 auth, S3-style storage, Deno edge functions, and hosting — through one interface, plus an OpenAI-compatible model gateway.
MCP Server2025
Provides a long‑lived, in‑process file and content search library for editors and AI agents, with typo‑resistant fuzzy matching, frecency‑ranked results, background watchers, and a lightweight in‑memory content index — optimized for repeated searches in long‑running processes.
AI Deploy2025
A ~5,000-line Python LLM inference engine that re-implements SGLang's serving optimizations — radix KV-cache reuse, chunked prefill, overlap scheduling, tensor parallelism — as a fully type-annotated reference instead of a black box.
AI Agent2025
Composes AI agent teams from a Ghost+Shell+Model formula: each Bot pairs a prompt/MCP/Skills Ghost with a Chat, ClaudeCode, or Dify shell and a model like Claude or DeepSeek. Bots form Teams that run as traceable Tasks, wired to GitHub and DingTalk.
AI Infra2025
Extends vLLM beyond text to serve omni-modal models — Qwen3-Omni, TTS like CosyVoice3, and diffusion image/video/audio generators — in one engine, adding the non-autoregressive Diffusion Transformer support the core project never targeted.
AI Agent2025
Declares and installs agent dependencies from an apm.yml manifest—skills, prompts, agents, plugins and MCP servers—with transitive resolution, security auditing, plugin packaging, and cross-host registries so agents are reproducible across repos.
AI Infra2025
Provides an NVFP4‑optimized training and inference infrastructure for long-form video diffusion models — supports multi-shot AR training, KV-cache and NVFP4 quantized inference, sequence-parallelism and async decoding for higher FPS and longer outputs.
AI Infra2025
Provides Gymnasium-style APIs and tooling to run isolated, networked execution environments for agentic reinforcement learning. Offers async/sync EnvClients, Docker/Kubernetes container providers, a web UI and CLI for scaffolding and deploying environments (Hugging Face Spaces); experimental and evolving.