AI Infra2025
Keeps codebases, PDFs, Slack, and docs continuously indexed for RAG and knowledge graphs by recomputing only what changed, not the whole dataset. You declare target state in Python; a Rust engine maintains it with per-row lineage back to the source.
MCP Server2025
Unifies enterprise knowledge into a permission-aware context layer that delivers citation-backed, explainable search and no-code or SDK-driven agentic workflow automation. Supports 50+ connectors, knowledge-graph retrieval, an MCP server, and bring-your-own-model self-hosting.
MCP Server2025
Lets AI agents like Claude Desktop and Cursor explore schemas and run SQL across Postgres, MySQL, MariaDB, SQL Server, and SQLite through one MCP server. A read-only mode stops the agent mutating data; no per-database drivers to wire up.
AI Infra2025
Runs and fine-tunes LLMs locally on Apple silicon via the MLX framework, pulling thousands of Hugging Face models with one command. Adds 4- and 8-bit quantization, LoRA and full fine-tuning, prompt caching, and distributed inference across Macs.
AI Infra2025
Transforms unstructured financial content—papers, news, blogs, and filings—into a queryable semantic knowledge graph for retrieval-augmented research. Combines domain-tuned LLMs, embedding-based search, and modular ingestion pipelines; aimed at quant research teams and institutional workflows.
AI Deploy2025
Splits LLM inference into separate prefill and decode GPU pools, then routes requests with KV-cache awareness to cut redundant recomputation. Reports up to 30x throughput on DeepSeek-R1 (GB200 NVL72) and works across TensorRT-LLM, vLLM, and SGLang.
MCP Server2025
Gives an LLM agent direct control of iOS and Android apps over one MCP interface, across simulators, emulators, and real devices. Reads the native accessibility tree to pick elements deterministically, using screenshot coordinates only as fallback.
AI Infra2025
Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.
AI Train2025
Provides a modular full-stack reinforcement learning stack to train and evaluate long-horizon, multi-turn tool-use LLM agents, including a performant trainer, a Tinker-compatible backend, agent orchestration, and Gymnasium-style environments for task design.
AI Infra2025
Runs Cloudflare Workers and Durable Objects on self-hosted nodes, storing each object as an independently replicated SQLite database in an S3-compatible bucket—enabling per-object sharding, hibernation, and ownership via object-storage compare-and-swap without a central control plane.
AI Infra2025
Federates MCP, A2A, and REST/gRPC backends behind a single gateway endpoint with centralized discovery, governance, and observability; optimizes agent and tool calling. Includes gRPC→MCP translation, plugin extensibility, OpenTelemetry tracing, and Kubernetes-ready deployment.
AI Infra2025
Converts PDFs into AI-ready structured outputs (Markdown, JSON with bounding boxes, HTML) for RAG and accessibility workflows; offers deterministic local parsing plus a hybrid AI mode for complex tables, OCR, formulas, and auto-tagging previews.