LogoAIAny
Icon for item

AIBrix

vLLM-project’s control-plane that orchestrates cost-efficient, plug-and-play LLM inference infrastructure.

Introduction

Overview

AIBrix provides Kubernetes operators and Helm charts to spin up horizontally scalable vLLM back-ends with minimal config.

Key Capabilities
  • Multi-tenant routing & quota
  • Elastic GPU pool management
  • Observability hooks for Prometheus/Grafana

Information

  • Websitegithub.com
  • AuthorsvLLM Project
  • Published date2025/02/21

Categories