A research codebase and model family for vision–language models that experiments with data‑centric post‑training strategies and long‑context multimodal reasoning. Includes model reports, released research weights (non‑commercial), grounding tools (LocateAnything) and integrations for inference/optimization.
Official code companion to the O'Reilly book by Jay Alammar and Maarten Grootendorst: 12 chapters of runnable notebooks on tokens, embeddings, Transformers, text classification, clustering, prompt engineering, semantic search, RAG, and fine-tuning.
Publishes a structured open textbook on large language model foundations, covering language modeling, LLM architectures, prompt engineering, PEFT, model editing, and RAG.
Open-source TTS that clones a voice from 3-10s of audio and synthesizes cross-lingual speech in 9 languages and 18+ Chinese dialects. Supports streaming at ~150ms latency with instruction control over emotion, speed, and accent.
Converts PDFs, images, and Office documents into Markdown or JSON for retrieval, extraction, and agent workflows, with OCR, layout analysis, formula handling, and multiple runtime modes.
Edits a codebase from natural-language prompts in the terminal, coordinating specialized sub-agents — file picker, planner, editor, reviewer — instead of one model. Beats Claude Code 61% vs 53% on its own evals; agents scriptable in TypeScript.
Runs an AI coding agent that edits, tests, and manages code across terminal, desktop, web, and GitHub repositories. Uses specialized agents and a curated model catalog (DeepSeek, MiMo, MiniMax, GPT-5.6) and offers free access supported by text ads.
Routes each user query to the most suitable agent via a classifier that weighs agent profiles and conversation history, keeping context shared across handoffs. Python and TypeScript, with a SupervisorAgent that runs sub-agents in parallel.
Drives UI automation from screenshots alone: describe steps in natural language and a vision model acts on what it sees, no DOM selectors. One API spans web, Android, iOS, HarmonyOS and desktop; plugs into Playwright/Vitest or runs autonomously.
Open-source platform for autonomous coding agents that work like developers: editing files, running shell commands, browsing the web, and calling APIs in an isolated sandbox. Model-agnostic, with GitHub, Slack, and CI/CD integration.
Runs huge mixture-of-experts LLMs like DeepSeek-R1/V3 on a single 24GB GPU plus CPU DRAM by keeping attention on the GPU and offloading expert weights to CPU. Reports 3-28x speedups via Intel AMX/AVX512 kernels and fits 139K context in 24GB VRAM.
Connects any LLM to internal knowledge sources and lets teams chat with cited, RAG-style answers. Notable for broad connectors (Drive, Notion, GitHub, YouTube), universal LLM/embedding support, and self-hostable Docker deployment — aimed at teams that need private, searchable LLM-backed knowledge.