AIAny
AI Client2026
Icon for item

Token Optimizer

Audits and reduces token waste in LLM sessions by compressing verbose outputs, checkpointing before compaction, and restoring lost context. Runs fully locally with zero telemetry and provides a live token dashboard plus plugins for Claude Code, OpenClaw and Codex.

Introduction

Most LLM-tooling focuses on compressing a single slice of output; the real cause of session quality loss is structural bloat and compaction loss that never gets measured. Token Optimizer tackles that blind spot by making every token visible and recoverable so sessions survive compactions and context quality doesn't quietly degrade.

What Sets It Apart
  • Measured, local-first approach: captures per-turn token breakdowns, cache reads, subagent spend and quality scores in a local SQLite store and a bookmarkable dashboard — nothing is sent off-host.
  • Smart compaction and checkpoints: snapshots session state at thresholds, archives large tool outputs, and restores critical decisions after compaction so you don't lose the work that led to decisions.
  • Active compression + structural fixes: delta-mode diffs on re-reads, AST-based structure summaries for large code files, and a growing set of CLI output compressors (git, pytest, linters, logs) to cut repetitive runtime noise.
  • Multi-platform integration: native plugins / adapters for Claude Code, OpenClaw and Codex (beta), with a single-file HTML dashboard and CLI for environments without extension support.
Who it's for — fit and trade-offs

Great fit if you run long, tool-heavy LLM sessions (multi-agent orchestration, code-heavy debugging, or repeated large file reads) and want reproducible token savings plus session continuity. The tool prioritizes safety: it never mutates existing in-context conversation blocks (avoids prompt-cache invalidation) and runs with zero runtime dependencies.

Look elsewhere if you require a cloud-hosted analytics service, need permissive commercial licensing for high-revenue enterprise use (the project ships under PolyForm Noncommercial), or if you prefer lossless, full-output retention for every CLI command — some compressors are intentionally lossy and are toggleable.

Information

  • Websitegithub.com
  • AuthorsAlex Greenshpun
  • Published date2026/02/26

Categories

More Items

GitHub
AI Agent2026

Provides a lightweight Python harness that turns LLMs into working agents with tool-use, skills, persistent memory, permission controls and multi-agent coordination. Ships with a CLI/React TUI, 43+ built-in tools, a plugin/skill system and the ohmo personal-agent for chat gateways. Best for developers prototyping agent workflows and multi-agent experiments.

GitHub
AI Model2026

Runs the Bonsai family of quantized LLMs locally (including vision-capable 27B): provides scripts and demo UIs to run 1-bit and ternary Bonsai models on macOS (Metal), Linux/Windows (CUDA/Vulkan/ROCm), or CPU, with long context, tool-calling and an optional Open WebUI agent demo.

GitHub
AI Client2025

Turns Chromium into a local-first AI browser with an embedded assistant that can summarise pages, extract structured data, automate web tasks, and run scheduled agents. Built as an open-source Chromium fork with 53+ built-in browser tools, 40+ app integrations, and support for BYO AI keys or fully local models (Ollama / LM Studio).