AIAny
Icon for item

OpenRouter LLM Rankings

Ranks LLMs by real production token usage, not benchmarks. Aggregates traffic from millions of users hitting 400+ models through one API — sliced by model, lab market share, tool-call frequency, and image volume, updated weekly.

Introduction

Benchmarks tell you which model is smartest; this tells you which one developers actually pay to run in production. The gap is often huge — a model can top every intelligence leaderboard yet sit seventh by real usage, while a cheaper rival quietly captures the bulk of the traffic. Because it draws on aggregated token flow across millions of users and 400+ models behind one API, it functions as a live market signal for the LLM industry rather than another scoreboard.

What Sets It Apart
  • Ranks by revealed preference — weekly token volume of paying traffic — so price/performance and reliability are baked into the numbers, not just lab-reported scores.
  • Slices the same data several ways: top models, token market share by lab, tool-call frequency, and image-processing volume, letting you see how models are used, not just that they're used.
  • Captures macro shifts early: open-vs-closed splits, the rise of Chinese-origin labs, and quarter-over-quarter throughput growth show up here before they hit headlines.
  • Vendor-neutral by construction — OpenRouter routes across 60+ providers, so no single lab's marketing skews the ranking.
Who It's For

Great fit if you're choosing a model for a real workload, sizing a market, or tracking adoption trends and want evidence over vendor claims. Look elsewhere if you need controlled capability evaluations — this measures what people deploy, which is shaped by cost, latency, and availability as much as raw intelligence. It also only reflects traffic that flows through OpenRouter, so models served mainly via first-party APIs are underrepresented.

Information

  • Websiteopenrouter.ai
  • AuthorsOpenRouter, Inc.
  • Published date2023/02/01

Categories

More Items

GitHub
AI Train2026

A challenge repository for training the best language model that fits inside a 16,000,000‑byte (16MB) submission artifact; provides baseline training code, FineWeb bpb evaluation, a public leaderboard, and compute-grant instructions for short 8×H100 runs.

GitHub

Runs one-command evaluation of vision-language models across 80+ multimodal benchmarks, handling data download, inference, and metric scoring in a single pass. Supports 220+ LMMs; adding a new model means writing one generate_inner() function.

Public leaderboard ranking LLMs and multimodal models across 70+ datasets — reasoning, knowledge, coding, math, and long-context. Blends open-source and proprietary benchmarks into one comparative view spanning GPT-4, Claude, Qwen, and InternLM.