AIAny
AI Infra2016
Icon for item

CuPy

Provides a NumPy/SciPy-compatible GPU array library for Python, enabling existing NumPy/SciPy numerical code to run on NVIDIA CUDA and AMD ROCm with minimal changes. Exposes low-level CUDA features (RawKernels, Streams) and offers prebuilt binaries for multiple CUDA/ROCm versions.

Introduction

GPUs are the default execution target for many modern ML and scientific workloads, but porting established NumPy/SciPy code to run efficiently on GPU often requires substantial rewrites. CuPy's central insight is pragmatic compatibility: let most existing numerical Python code keep using the same API while executing on the GPU, and provide escape hatches when you need fine-grained control.

What Sets It Apart
  • NumPy/SciPy API compatibility — you can reuse array code, indexing, ufuncs and many SciPy routines with minimal edits, which reduces porting risk and accelerates iterations.
  • Low-level GPU access when needed — RawKernels, Streams and direct CUDA Runtime API bindings mean you can drop into custom CUDA C/C++ kernels or tune concurrency for hotspots without leaving the CuPy ecosystem.
  • Multi-platform binary packaging and ecosystem integration — prebuilt wheels for common CUDA versions (and experimental ROCm support), Docker images and active ties to CUDA libraries let teams deploy GPU-accelerated workloads faster than rebuilding from source.
  • Practical engineering tradeoffs — the project prioritizes pragmatic coverage of the NumPy/SciPy surface and interop rather than reimplementing every niche SciPy routine; signal-processing functionality (cuSignal) was merged into the project from v13 onward.
Who It's For & Tradeoffs

Great fit if you need to accelerate existing numeric or scientific Python code on a single GPU (or small GPU fleet), want a familiar NumPy-like API during migration, or require direct CUDA interop for custom kernels and performance tuning. Look elsewhere if you need a full deep-learning training framework with built-in autodiff and high-level training primitives (use PyTorch/TF/JAX for that), if your deployment environment lacks compatible GPU drivers, or if you require fully mature ROCm parity (ROCm support is marked experimental in some releases). CuPy reduces porting cost but does not remove all engineering work: GPU memory management, kernel tuning and some SciPy submodules still need manual attention.

Information

  • Websitegithub.com
  • OrganizationsPreferred Networks
  • AuthorsRyosuke Okuta, Yuya Unno, Daisuke Nishino, Shohei Hido, Crissman Loomis
  • Published date2016/11/01

Categories

More Items

GitHub
AI Infra2022

Provides runtime support for reversible effects and reactive coeffects so components can be declared, composed, and hot-replaced safely; includes effect tracking, coeffect resolution, a declarative component loader and HMR — aimed at plugin-driven agent harnesses and dynamic systems.

GitHub

Provides a unified integration layer that lets AI agents call and manage third‑party service APIs while keeping credentials and approval workflows out of the agent's reach. Offers plugin-based integrations, per-tenant envelope encryption (KEK), configurable permission modes, and an optional Hub to host OAuth/webhook surfaces.

Frames LLM routing as a sequential decision process and introduces LLMRouter plus the xRouteBench benchmark to develop, evaluate, and deploy learned routing policies across heterogeneous LLMs, optimizing response quality versus inference cost.