AIAny
AI Infra2025
Icon for item

Models.dev

Provides a community-curated database of AI model metadata—specs, pricing, and capabilities—and exposes it via a JSON API and a TOML-based contributor workflow for programmatic lookup and integration.

Introduction

Centralizing reliable, provider-agnostic model metadata makes it far easier to compare, integrate, and build tooling across multiple LLM vendors. Models.dev keeps normalized model facts and provider-specific serving details in a machine-readable repo and ships a simple JSON API so other tools can consume the catalog programmatically.

What Sets It Apart
  • Provider-agnostic model metadata lives under models/ while provider-specific serving details (pricing, limits, endpoints) live under providers/, avoiding duplication and making it easy to mirror or override facts.
  • Data is stored as human-editable TOML files with CI validation, plus generated JSON endpoints (e.g., models.json, api.json, catalog.json) and SVG logos for programmatic use by SDKs and UIs.
  • Designed for integration: intended consumers include AI SDKs, MLOps tooling, catalog UIs, and internal systems that need consistent model specs rather than vendor docs scattered across sites.
Who It's For and Trade-offs

Great fit if you build developer tools, MLOps pipelines, or SDKs that need normalized model metadata and provider comparisons. The repo’s validation and schema reduce inconsistency, but coverage depends on community contributions and may lag for niche providers; it’s a metadata/catalog service, not a model-weight host—weights/benchmarks are linked where available. Expect to contribute or sync regularly if you rely on the most up-to-date pricing or new provider offerings.

Information

  • Websitegithub.com
  • Organizationsanomalyco, SST
  • Published date2025/06/04

Categories

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.