AIAny
AI Infra2021
Icon for item

SkyPilot

Runs, manages, and scales AI workloads across 20+ clouds, Kubernetes, Slurm, and on-prem from one YAML or Python spec. Auto-provisions GPUs/TPUs, fails over across regions and providers when capacity is short, and routes jobs to the cheapest option.

Introduction

GPU scarcity turned "which cloud" into a daily scramble: the cheapest A100s might be on Lambda today, GCP tomorrow, and your own Kubernetes cluster when both run dry. SkyPilot's bet is that the job spec should outlive the infrastructure — you describe what to run once, and it decides where, provisioning across 20+ clouds, Slurm, and Kubernetes and failing over automatically when a region runs out of capacity.

What Sets It Apart
  • Write once, run on any infra. A single YAML or Python spec maps onto AWS, GCP, Azure, OCI, RunPod, Lambda, Nebius, and on-prem clusters, so you stop maintaining a separate launch script per provider.
  • Spot jobs that babysit themselves. Managed jobs checkpoint and re-provision preempted spot instances on their own, turning cheap-but-fragile capacity into something you can actually train on overnight.
  • A scheduler that optimizes for price and availability together. At launch it compares real-time cost and GPU availability across regions and providers and picks the cheapest option that actually has the hardware, instead of dying on a quota wall.
  • One control plane for messy fleets. Infra teams get a single place to enforce scheduling, quotas, and automatic teardown across otherwise heterogeneous compute.
Great Fit / Look Elsewhere

Great fit if you train or batch-infer across more than one cloud, chase spot capacity to cut cost, or want workloads portable enough that you're never locked into one vendor's console. Look elsewhere if you live entirely inside a single managed platform like SageMaker or Vertex and value its native integrations over portability, or if your whole world is one fixed on-prem box — then SkyPilot's orchestration layer is overhead you won't use.

Information

  • Websitegithub.com
  • OrganizationsSky Computing Lab, UC Berkeley
  • Authorsskypilot-org, Sky Computing Lab (UC Berkeley)
  • Published date2021/08/11

More Items

GitHub
AI Infra2025

Defines a vendor-neutral JSON/YAML semantic model specification and tooling to exchange metrics, dimensions, lineage and other business semantics across analytics, AI and BI platforms; includes a core spec, validators, converters (dbt, GoodData, Salesforce) and example models.

GitHub
AI Deploy2018

Serves machine learning and deep learning models for cloud, data center, edge and embedded environments. Supports multiple frameworks and backends, dynamic and sequence batching, HTTP/gRPC APIs, Docker deployment and NVIDIA-optimized runtimes.

GitHub
AI Train2025

An asynchronous, high-throughput framework for large-scale reinforcement learning and agentic training that scales to 1T+ MoE models and 1000+ GPUs, with native verifiers integration, end-to-end SFT/RL/evals, and Slurm/Kubernetes deployment; requires NVIDIA GPUs.