AIAny
AI Client2023
Icon for item

LLM

Run prompts against OpenAI, Claude, Gemini, and dozens of local or remote models from one terminal command, logging every prompt and response to SQLite. Plugins add new providers, tools, and embeddings; supports schema extraction and function calling.

Introduction

Most ways of talking to a language model are either locked to one vendor's SDK or trapped in a chat window that forgets everything the moment you close the tab. This tool makes the opposite bet: every model — GPT, Claude, Gemini, or a Llama running on your laptop — becomes an interchangeable Unix command, and every prompt and response lands in a SQLite database you can later query, pipe, and audit.

What Sets It Apart
  • Provider-agnostic by design. Swapping gpt-4o for a hosted Claude model or a local one is a single flag, so prompts and scripts outlive any one vendor's API.
  • Everything is logged to SQLite. Each interaction is searchable and replayable, turning throwaway prompting into an auditable record you can mine weeks later.
  • A plugin ecosystem, not a monolith. Community plugins add new model providers, embedding models, tools, and fragment loaders, keeping the core small while coverage keeps expanding.
  • Structured output and tool calling are first-class. JSON-schema extraction and function calling let it act as a data-extraction or agent primitive inside shell pipelines, not just an interactive chat.
Who Should Use It

Great fit if you live in the terminal, want reproducible and auditable LLM calls, or need to wire models into shell scripts, cron jobs, and embedding workflows. Look elsewhere if you want a polished graphical chat interface or a managed agent platform — this is deliberately a composable building block, and getting the most from it means embracing the command line and SQLite over a point-and-click UI.

Information

  • Websitegithub.com
  • AuthorsSimon Willison
  • Published date2023/04/01

Categories

More Items

GitHub
AI Agent2026

Provides a lightweight Python harness that turns LLMs into working agents with tool-use, skills, persistent memory, permission controls and multi-agent coordination. Ships with a CLI/React TUI, 43+ built-in tools, a plugin/skill system and the ohmo personal-agent for chat gateways. Best for developers prototyping agent workflows and multi-agent experiments.

GitHub
AI Model2026

Runs the Bonsai family of quantized LLMs locally (including vision-capable 27B): provides scripts and demo UIs to run 1-bit and ternary Bonsai models on macOS (Metal), Linux/Windows (CUDA/Vulkan/ROCm), or CPU, with long context, tool-calling and an optional Open WebUI agent demo.

GitHub
AI Client2025

Turns Chromium into a local-first AI browser with an embedded assistant that can summarise pages, extract structured data, automate web tasks, and run scheduled agents. Built as an open-source Chromium fork with 53+ built-in browser tools, 40+ app integrations, and support for BYO AI keys or fully local models (Ollama / LM Studio).