AIAny
AI Deploy2026
Icon for item

codex-lb

Pools multiple ChatGPT/Codex accounts behind a local OpenAI-compatible proxy and dashboard — provides request load balancing, per-account usage/cost tracking, API-key management, and configurable routing strategies.

Introduction

Most friction when integrating hosted LLM access comes from quota limits, per-account rate controls, and client tooling that expects a single OpenAI endpoint. codex-lb addresses that operational gap by pooling multiple ChatGPT/Codex accounts and exposing a single OpenAI‑compatible endpoint with usage accounting and a management UI.

What Sets It Apart
  • Account pooling with usage-aware routing: multiple selection strategies (capacity-weighted, relative availability, usage-weighted, round-robin, etc.) let operators steer traffic by quota headroom and recent usage rather than blind round-robin. So what: smooths consumption across accounts and reduces sudden quota exhaustion on a single account.
  • OpenAI/Codex-compatible frontends: exposes both /v1 (OpenAI Responses-style) and backend-api/codex routes and integrates with Codex CLI, OpenCode, OpenClaw and standard OpenAI SDK clients. So what: existing clients need minimal or no changes to switch to a pooled backend.
  • Per-account accounting and API-key management: tracks tokens, cost, 28‑day trends and supports per-key rate limits, model allowlists, expirations, and dashboard-created keys. So what: helps operators enforce limits and audit usage centrally.
  • Production deployment primitives: first-run bootstrap token, support for SQLite or PostgreSQL, Docker/Helm manifests, multi-replica session bridge and observability hooks. So what: easier to run behind a reverse proxy or in Kubernetes for remote teams.
Who It's For & Trade-offs

Great fit if you operate multiple upstream ChatGPT/Codex accounts and need a single, OpenAI-compatible façade for tooling or teams — for example, internal developer tools, CLI workflows, or small multi-tenant setups. It’s also useful when clients require the Responses API semantics (reasoning state) that Codex-style endpoints provide.

Look elsewhere if you require a turnkey, fully managed multi-account service or if you plan to drive high-volume, policy-risky traffic: codex-lb is an operator-managed proxy that depends on you maintaining account credentials and staying within upstream terms of service. Also note the default security posture: API-key auth is disabled by default (local requests allowed), so remote deployments must enable key auth or place the service behind network/reverse-proxy access controls.

Where It Fits

Positioned as an operational glue layer — not a model host. It does not replace upstream provider billing or guarantee account safety; instead it reduces client integration friction and adds per-account telemetry and routing controls, making it practical to scale usage across several provider accounts without rewriting client code.

Information

  • Websitegithub.com
  • AuthorsSoju06
  • Published date2026/01/07

Categories

More Items

Hugging Face
AI Deploy2026

Evaluates multi-field JSON schemas in parallel to extract boolean or categorical field values from text, producing guaranteed-valid JSON and per-field calibrated confidences. Uses KV-cache broadcasting, sub-vocabulary logit slicing and token-tree disambiguation to cut latency (5.6x–7.0x on M4 Max) versus autoregressive decoding; requires Apple Silicon and MLX.

GitHub
AI Deploy2026

Provides reusable Docker compose files, scripts and benchmarked configs to serve modern LLMs (Qwen, Gemma, etc.) on 1–2 NVIDIA RTX 3090/4090/5090 GPUs. Multi-engine (vLLM, llama.cpp, ik_llama), measured TPS/context tradeoffs, and validated single/dual‑GPU recipes.

GitHub
AI Deploy2023

Provides a unified platform for AI development and deployment, including the MAX serving framework and the Mojo systems programming language for writing kernels. Offers an OpenAI-compatible inference endpoint, Mojo-written CPU/GPU kernels, and tools to run hundreds of open models across diverse hardware without vendor lock-in.