AI Image2024
Turns a UI screenshot into structured elements so a vision LLM can act without HTML or accessibility trees. A fine-tuned detector finds interactable icons; a caption model describes their function, lifting GPT-4V grounding on ScreenSpot and Mind2Web.
AI Infra2024
Official inference framework for 1-bit and ternary (1.58-bit) LLMs such as BitNet b1.58, with optimized CPU kernels. Delivers 1.37x-6.17x speedups and 55-82% lower energy on x86 and ARM, and runs a 100B model on a single CPU at 5-7 tokens/sec.
AI Audio2024
Chains four swappable open modules — voice activity detection, speech-to-text, an LLM, and text-to-speech — into a local voice agent that needs no proprietary APIs. Runs on CUDA, Apple Silicon, or Docker, with an OpenAI-compatible realtime WebSocket mode.
AI Agent2024
Developer framework for building AI agents that autonomously trade on Polymarket prediction markets. Bundles the Polymarket and Gamma APIs, a Chroma RAG layer that pulls in news, and a CLI to query markets, reason with an LLM, and execute trades.
AI Infra2024
Runs local LLM, vision-language, ASR, OCR, and image-generation models across NPU, GPU, and CPU from one command. Differs from Ollama and llama.cpp with first-class Qualcomm Hexagon NPU support and day-0 coverage of new models like Qwen3-VL.
AI Train2024
Trains a sub-100M-parameter LLM from scratch — pretraining, SFT, LoRA, DPO/RLHF, and distillation, sized from ~26M up to ~100M-plus dense and MoE. Headline figure: the ~64M minimind-3 variant's SFT stage runs 1 epoch in ~2h and ~3 RMB on one NVIDIA 3090.
AI Agent2024
Stores agent memory as human- and agent-readable Markdown files with wikilinks instead of an opaque vector DB. Auto Memory/Resource/Dream jobs distill conversations into long-term notes, and hybrid wikilink + BM25 + embedding search retrieves them.
AI Client2024
Desktop finance analytics terminal that combines CFA-level models, real-time trading and 100+ data connectors with embedded Python for analytics; includes 37 AI agents and local/multi-provider LLM support for automated research and decision workflows.
AI Image2024
Trains a 65M-parameter vision-language model from scratch in ~2 hours on one RTX 3090, about 3 RMB (~$0.40) of GPU rental. Connects a frozen SigLIP2 encoder to a small MiniMind LLM via a two-layer MLP projector; full PyTorch code for pretraining and SFT.
AI Image2024
Turns PDFs and images into clean Markdown with a 7B vision-language model, keeping tables, equations, handwriting, and multi-column reading order while removing headers and footers. Runs on one 12GB+ GPU at about 1/32 the cost of GPT-4o APIs.
MCP Server2024
Official Python implementation of the Model Context Protocol. Build servers that expose tools, resources, and prompts to any MCP host, or clients that connect to any server; type hints and docstrings become the schemas, so a server fits in ~15 lines.