AI Infra2022
Unified Python framework where the same code runs on batch and streaming data, backed by a Rust engine on Differential Dataflow for incremental computation. Aimed at ETL, analytics, and live RAG pipelines over Kafka and 300+ connectors.
Chatbot2022
Connects one LLM agent to 15+ chat platforms — QQ, WeChat Work, Feishu, Telegram, Discord, Slack — from a single self-hosted backend. Routes to OpenAI, Anthropic, Gemini, DeepSeek or Ollama, and adds a WebUI, MCP tools, and a 1000+ plugin marketplace.
AI Infra2023
Lets you write compositional Python programs that compile into self‑improving LLM pipelines — replacing brittle prompt engineering with a declarative, programmatic approach and built‑in algorithms to optimize prompts and weights for RAG, multi‑stage pipelines, and agent loops.
AI API2023
Routes one API call across hundreds of LLMs from dozens of providers, with credits, fallbacks, pricing comparison, and data-policy controls for teams that need model choice without wiring every provider separately.
AI Agent2023
Turns documents, web pages and audio into a private, searchable knowledge base and builder for AI assistants and agents — supports wide-format ingestion, multi-model (cloud or local) execution, retrieval-augmented responses, and enterprise deployment features like RBAC and SSO.
AI Infra2023
Aggregates alerts from dozens of monitoring tools into a single pane of glass, then deduplicates, correlates, and enriches them. Automates incident response with declarative YAML workflows — like GitHub Actions for your monitoring stack.
AI Infra2023
Provides a minimal, Zig-written headless browser tailored for AI agents and automation — runs JavaScript, supports key Web APIs, exposes the Chrome DevTools Protocol for Puppeteer/Playwright, and targets low memory usage and fast startup for large-scale scraping and agent workflows.
AI Deploy2023
Open-source LLM inference and serving engine built around PagedAttention, which manages the KV cache like OS virtual memory to cut waste and raise throughput. Supports continuous batching, KV cache sharing, quantization, and an OpenAI-compatible API.
AI Audio2023
Reimplements OpenAI's Whisper speech-to-text on the CTranslate2 inference engine, running up to 4x faster at the same accuracy while using less memory. Adds a batched pipeline, 8-bit quantization, VAD filtering, and word-level timestamps.
AI Infra2023
Runs AI-generated code in secure, isolated cloud sandboxes you control via Python or JavaScript SDKs; supports self-hosting (Terraform) and AWS/GCP, enabling agents and code-interpreting workflows to execute real-world tools safely.
AI Infra2023
Runs large language models entirely in C/C++ with no external dependencies, using 1.5-to-8-bit integer quantization and CPU+GPU hybrid inference to fit models larger than available VRAM. Backs Ollama, LM Studio, and most local-inference tooling.
AI Agent2023
Builds production RAG systems around deep document understanding, explainable chunking, hybrid retrieval, citations, and agent workflows for messy enterprise documents.