AIAny
AI Infra2021
Icon for item

SkyPilot

Runs, manages, and scales AI workloads across 20+ clouds, Kubernetes, Slurm, and on-prem from one YAML or Python spec. Auto-provisions GPUs/TPUs, fails over across regions and providers when capacity is short, and routes jobs to the cheapest option.

Introduction

GPU scarcity turned "which cloud" into a daily scramble: the cheapest A100s might be on Lambda today, GCP tomorrow, and your own Kubernetes cluster when both run dry. SkyPilot's bet is that the job spec should outlive the infrastructure — you describe what to run once, and it decides where, provisioning across 20+ clouds, Slurm, and Kubernetes and failing over automatically when a region runs out of capacity.

What Sets It Apart
  • Write once, run on any infra. A single YAML or Python spec maps onto AWS, GCP, Azure, OCI, RunPod, Lambda, Nebius, and on-prem clusters, so you stop maintaining a separate launch script per provider.
  • Spot jobs that babysit themselves. Managed jobs checkpoint and re-provision preempted spot instances on their own, turning cheap-but-fragile capacity into something you can actually train on overnight.
  • A scheduler that optimizes for price and availability together. At launch it compares real-time cost and GPU availability across regions and providers and picks the cheapest option that actually has the hardware, instead of dying on a quota wall.
  • One control plane for messy fleets. Infra teams get a single place to enforce scheduling, quotas, and automatic teardown across otherwise heterogeneous compute.
Great Fit / Look Elsewhere

Great fit if you train or batch-infer across more than one cloud, chase spot capacity to cut cost, or want workloads portable enough that you're never locked into one vendor's console. Look elsewhere if you live entirely inside a single managed platform like SageMaker or Vertex and value its native integrations over portability, or if your whole world is one fixed on-prem box — then SkyPilot's orchestration layer is overhead you won't use.

Information

  • Websitegithub.com
  • OrganizationsSky Computing Lab, UC Berkeley
  • Authorsskypilot-org, Sky Computing Lab (UC Berkeley)
  • Published date2021/08/11

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.