AI Image2024
Segments each PDF page into 11 labeled regions — titles, tables, formulas, figures, footnotes and more — and recovers reading order. Offers two engines: an accurate VGT visual model (~0.96 F1) or a faster CPU-only LightGBM ensemble.
AI Train2024
Streamlines the full lifecycle of foundation models — data prep, fine-tuning (SFT/LoRA/QLoRA/GRPO), evaluation, and deployment — with ready-to-run recipes, multi-engine inference support, and cloud/CLI workflows for both laptop experiments and large-scale runs.
MLOps2024
Runs reproducible evaluations of large language models through a Python API with built-in solvers, scorers, and model-graded grading. Ships 200+ ready-to-run evals spanning capability and safety testing, and connects to most major model providers.
AI API2024
Build AI workflows once and run them across model providers — GoogleAI, OpenAI, Claude, Ollama — through one SDK. Composable primitives for RAG, tool use, and agents, plus a local dev UI for tracing and debugging, with SDKs in JS/TS, Go, and Python.
AI API2024
Ingests documents, images, audio, video and web pages and converts them into structured, LLM-friendly markdown and parsed data. Runs locally (fits on a T4 GPU), supports ~20 file types, offers OCR, transcription, table extraction and a Gradio UI; deployable via Docker/Skypilot. Licensed under GPL-3.0; some model weights carry cc-by-nc-sa restrictions for commercial use.
AI Agent2024
Combines drag-and-drop field binding with natural-language prompts so an AI agent derives the transformations behind charts your raw tables can't produce. Reads from databases, files, images, and websites; 30+ chart types and branchable threads.
AI Agent2024
Provides a Python framework for building generative-AI agents and workflows with Pydantic-style type safety and composable capabilities. Model-agnostic provider support, built-in observability, human-in-the-loop tool approval, and durable execution for production use cases.
AI Model2024
Provides code, pretrained weights, and tooling for protein language models and structure prediction — including ESMC, ESMFold2, sparse autoencoders (SAEs), and the ESM Atlas. Includes model checkpoints, tutorials, Hugging Face & Biohub integration, and an MIT license.
AI Infra2024
Disaggregated LLM serving architecture that splits prefill and decode into separate clusters and pools spare CPU, DRAM, and SSD into a distributed KVCache. Powers Kimi in production, handling 75% more requests under the same SLOs.
Official code companion to the O'Reilly book by Jay Alammar and Maarten Grootendorst: 12 chapters of runnable notebooks on tokens, embeddings, Transformers, text classification, clustering, prompt engineering, semantic search, RAG, and fine-tuning.
AI Infra2024
Provides a GenLayer DApp boilerplate implementing a football-bets intelligent contract with web and LLM integration. Bundles fast in-memory direct tests with web/LLM mocking, a GenVM linter, integration test workflows, CI, and a Next.js 15 TypeScript frontend.
AI Agent2024
Crawls 30+ social platforms (Weibo, Xiaohongshu, Douyin), parses their video and image content, then has five specialized agents debate in a moderated forum to synthesize public-opinion reports. Can fuse public sentiment with a private business database.