AI Client2024
Visually edit Next.js + Tailwind projects in the browser like Figma, with every change written straight back to your real React code. Pairs a DOM-level visual canvas with AI chat that scaffolds and edits components, plus branching and one-click deploy.
AI Infra2024
Disaggregated LLM serving architecture that splits prefill and decode into separate clusters and pools spare CPU, DRAM, and SSD into a distributed KVCache. Powers Kimi in production, handling 75% more requests under the same SLOs.
Official code companion to the O'Reilly book by Jay Alammar and Maarten Grootendorst: 12 chapters of runnable notebooks on tokens, embeddings, Transformers, text classification, clustering, prompt engineering, semantic search, RAG, and fine-tuning.
AI Infra2024
Provides a GenLayer DApp boilerplate implementing a football-bets intelligent contract with web and LLM integration. Bundles fast in-memory direct tests with web/LLM mocking, a GenVM linter, integration test workflows, CI, and a Next.js 15 TypeScript frontend.
Publishes a structured open textbook on large language model foundations, covering language modeling, LLM architectures, prompt engineering, PEFT, model editing, and RAG.
AI API2024
aisuite is a lightweight Python library that provides a unified API for working with multiple Generative AI providers. It supports models from OpenAI, Anthropic, Google, Hugging Face, AWS, Cohere, Mistral, Ollama, and others—abstracting away SDK differences, authentication details, and parameter variations. Modeled after OpenAI’s API style, it enables developers to build LLM-based or agentic applications across providers with minimal setup.
AI Audio2024
Open-source TTS that clones a voice from 3-10s of audio and synthesizes cross-lingual speech in 9 languages and 18+ Chinese dialects. Supports streaming at ~150ms latency with instruction control over emotion, speed, and accent.
AI Infra2024
Converts PDFs, images, and Office documents into Markdown or JSON for retrieval, extraction, and agent workflows, with OCR, layout analysis, formula handling, and multiple runtime modes.
AI Agent2024
Local-first runtime for autonomous AI agents that run on-device and stay model-agnostic across OpenAI, Anthropic, Gemini, Grok, and local models. A plugin system adds chat platforms (Discord, Telegram, X), voice, browser automation, RAG, and wallets.
AI Coding2024
Edits a codebase from natural-language prompts in the terminal, coordinating specialized sub-agents — file picker, planner, editor, reviewer — instead of one model. Beats Claude Code 61% vs 53% on its own evals; agents scriptable in TypeScript.
AI Coding2024
Packs a Git repository into a single AI-friendly file for easy ingestion by LLMs. Offers per-file and total token counts, optional Tree-sitter compression, secret scanning, and multiple interfaces (CLI, web, browser extension, Docker, MCP) for AI-driven code review and analysis.
AI Model2024
An instruction-tuned 8B Llama 3.1 model for multilingual conversational text generation, built for assistant-style chat and long-context inputs (up to 128k tokens). Available for use via the Transformers pipeline and inference endpoints, with common optimizations like safetensors.