AI Agent2024
Routes each user query to the most suitable agent via a classifier that weighs agent profiles and conversation history, keeping context shared across handoffs. Python and TypeScript, with a SupervisorAgent that runs sub-agents in parallel.
AI Infra2024
Drives UI automation from screenshots alone: describe steps in natural language and a vision model acts on what it sees, no DOM selectors. One API spans web, Android, iOS, HarmonyOS and desktop; plugs into Playwright/Vitest or runs autonomously.
AI Agent2024
Open-source platform for autonomous coding agents that work like developers: editing files, running shell commands, browsing the web, and calling APIs in an isolated sandbox. Model-agnostic, with GitHub, Slack, and CI/CD integration.
AI Infra2024
kvcache-ai (maintainers / MADSys group, Tsinghua University & contributors)MADSys Lab, Tsinghua University, Approaching.AI +1
Runs huge mixture-of-experts LLMs like DeepSeek-R1/V3 on a single 24GB GPU plus CPU DRAM by keeping attention on the GPU and offloading expert weights to CPU. Reports 3-28x speedups via Intel AMX/AVX512 kernels and fits 139K context in 24GB VRAM.
AI Client2024
Connects any LLM to internal knowledge sources and lets teams chat with cited, RAG-style answers. Notable for broad connectors (Drive, Notion, GitHub, YouTube), universal LLM/embedding support, and self-hostable Docker deployment — aimed at teams that need private, searchable LLM-backed knowledge.
AI Image2024
Turns a UI screenshot into structured elements so a vision LLM can act without HTML or accessibility trees. A fine-tuned detector finds interactable icons; a caption model describes their function, lifting GPT-4V grounding on ScreenSpot and Mind2Web.
AI Infra2024
Official inference framework for 1-bit and ternary (1.58-bit) LLMs such as BitNet b1.58, with optimized CPU kernels. Delivers 1.37x-6.17x speedups and 55-82% lower energy on x86 and ARM, and runs a 100B model on a single CPU at 5-7 tokens/sec.
AI Audio2024
Chains four swappable open modules — voice activity detection, speech-to-text, an LLM, and text-to-speech — into a local voice agent that needs no proprietary APIs. Runs on CUDA, Apple Silicon, or Docker, with an OpenAI-compatible realtime WebSocket mode.
AI Video2024
Generates Netflix-quality single-line subtitles and optional dubbing for videos by automating download, ASR, word-level alignment, translation, terminology management and TTS integration. Emphasizes word-level alignment with WhisperX and cinematic translation/adaptation for cleaner, single-line subtitles and smoother dubbing.
AI Agent2024
Developer framework for building AI agents that autonomously trade on Polymarket prediction markets. Bundles the Polymarket and Gamma APIs, a Chroma RAG layer that pulls in news, and a CLI to query markets, reason with an LLM, and execute trades.
AI Dataset2024
Structured dataset for training and evaluating LLM agentic behavior: function-calling conversations, JSON-mode structured outputs, and extraction samples for teaching models to generate tool calls and strict structured responses. Includes single-turn and multi-turn scenarios across several configs.