Category

Firecrawl

Turns any website into clean markdown, structured JSON, or screenshots through a single API — handling JavaScript rendering, rotating proxies, rate limits, and full-site crawling so LLM apps get web data without running scraping infrastructure.

MLX-VLM

Provides local inference, fine-tuning, and a server/CLI for vision–language and omni (image/audio/video) models via MLX. Supports multi-image chat, audio/video inputs, activation quantization (CUDA), TurboQuant KV cache, and LoRA/QLoRA fine-tuning for on-device workflows.

Ant Design X

React components for building LLM chat and agent interfaces: message bubbles, prompt sets, conversation lists, and sender inputs under a RICH interaction paradigm, plus a streaming Markdown renderer and hooks for wiring UI to model data streams.

Genkit - Open-source AI framework by Google in JavaScript, Go and Python

Build AI workflows once and run them across model providers — GoogleAI, OpenAI, Claude, Ollama — through one SDK. Composable primitives for RAG, tool use, and agents, plus a local dev UI for tracing and debugging, with SDKs in JS/TS, Go, and Python.

OmniParse

Ingests documents, images, audio, video and web pages and converts them into structured, LLM-friendly markdown and parsed data. Runs locally (fits on a T4 GPU), supports ~20 file types, offers OCR, transcription, table extraction and a Gradio UI; deployable via Docker/Skypilot. Licensed under GPL-3.0; some model weights carry cc-by-nc-sa restrictions for commercial use.

aisuite

aisuite is a lightweight Python library that provides a unified API for working with multiple Generative AI providers. It supports models from OpenAI, Anthropic, Google, Hugging Face, AWS, Cohere, Mistral, Ollama, and others—abstracting away SDK differences, authentication details, and parameter variations. Modeled after OpenAI’s API style, it enables developers to build LLM-based or agentic applications across providers with minimal setup.

DeepSeek API

Offers OpenAI- and Anthropic-compatible access to DeepSeek models, including chat, reasoning, tool calls, JSON output, long-context variants, pricing, rate limits, and agent-tool integration guides.

Letta

Gives LLM agents self-editing memory that persists across sessions, so they keep learning about a user instead of resetting each chat. Model-agnostic: bring your own LLM while it handles the memory and agent state, run via API or open source.

Docling

Converts PDFs, Office files, HTML, images and audio into one structured DoclingDocument, with deep PDF layout, reading order, table-structure and formula recognition, OCR, and native LangChain/LlamaIndex/Haystack integrations for RAG pipelines.

AutoGPT

Give an agent a goal and it plans, then executes each step using AI models and your everyday apps. Build agents via chat-driven AutoPilot, a drag-and-drop builder, or self-hosted code, then run them on a schedule across integrations.

xAI — Creators of Grok, the AI Chatbot

Provides a unified developer API for Grok text, reasoning, voice, image, video, search, and file workflows, with OpenAI-compatible endpoints and first-party SDK examples.

Vexa

Runs a self-hosted meeting bot and transcription API that joins Google Meet, Teams and Zoom and streams speaker-attributed transcripts in real time. Compiles meetings into a git-backed Markdown workspace and runs sandboxed agents on your infrastructure; Apache-2.0 and air-gap capable.