Tag
Explore by tags
Official Go implementation of the Model Context Protocol for building MCP servers and clients. Tool handlers are type-safe, with JSON schemas inferred from Go structs via generics. Ships stdio, command, streamable-HTTP, SSE, and in-memory transports.
Builds production-grade AI agents and multi-agent workflows in .NET and Python, with graph-based orchestration for sequential, concurrent, and handoff patterns. Unifies Microsoft's Semantic Kernel and AutoGen lineages, adding durable, checkpointed runs.
Converts PDFs into AI-ready structured outputs (Markdown, JSON with bounding boxes, HTML) for RAG and accessibility workflows; offers deterministic local parsing plus a hybrid AI mode for complex tables, OCR, formulas, and auto-tagging previews.
Builds production AI agents around a model-driven loop with provider abstraction, tools, guardrails, streaming, MCP, tracing, and multi-agent patterns across Python and TypeScript SDKs.
Reimplements the vLLM inference engine from scratch in ~1,200 lines of readable Python, matching its offline throughput on small models. Prefix caching, tensor parallelism, torch.compile, and CUDA graphs are all kept legible.
A toolkit and open-weights system for real-time streaming music generation — offers two model sizes (230M / 2.4B), a Python inference library (JAX/MLX), and a C++ engine optimized for Apple Silicon for embedding into DAWs and apps; real-time streaming requires M‑series chips.
Provides a unified Python interface to collect data, train visual/dynamics world models, and evaluate them with model-predictive control across many standardized environments. Includes reference baselines, planning solvers, dataset converters, and LanceDB-backed formats for reproducible experiments. Best suited for researchers benchmarking world-model algorithms.
Stores a pruned proximity graph instead of all embeddings, recomputing vectors on demand at query time. A 60M-doc index takes 6GB, not 201GB (97% less), at comparable recall. Powers private local RAG over files, mail, chat, and browser history.
Forecasts financial candlesticks (OHLCV K-lines) with a decoder-only transformer pre-trained on 12B+ records from 45 exchanges. A tokenizer turns market data into discrete tokens, enabling price/volatility forecasting and synthetic K-line generation.
Model-compression toolkit for large LLMs/VLMs that integrates quantization (FP8/INT4/etc.), speculative decoding, token pruning and deployment hooks—designed for end-to-end performance on single/multi-GPU inference workflows and research-to-prod model optimization.
Provides a long‑lived, in‑process file and content search library for editors and AI agents, with typo‑resistant fuzzy matching, frecency‑ranked results, background watchers, and a lightweight in‑memory content index — optimized for repeated searches in long‑running processes.
A ~5,000-line Python LLM inference engine that re-implements SGLang's serving optimizations — radix KV-cache reuse, chunked prefill, overlap scheduling, tensor parallelism — as a fully type-annotated reference instead of a black box.