AIAny
AI Infra2024
Icon for item

cuTile Python

Lets Python developers write tile-based parallel kernels for NVIDIA GPUs, generating CUDA Tile IR while staying close to Python syntax for custom GPU operations.

Introduction

GPU programming often forces a choice between high-level tensor libraries and low-level CUDA kernels. cuTile Python sits between them by exposing a Python-facing way to express tile-based parallel work.

What Sets It Apart

The programming model makes data movement and work units explicit, then lowers to CUDA Tile IR for NVIDIA GPUs. It keeps examples close to Python syntax while documenting concrete hardware and toolchain requirements.

Who Should Use It

Great fit if you explore custom kernels on NVIDIA hardware and want a Python-first surface. Look elsewhere if you need broad vendor portability, older GPU support, or a tensor API that hides kernels entirely.

Information

  • Websitegithub.com
  • OrganizationsNVIDIA
  • AuthorsNVIDIA CORPORATION
  • Published date2024/10/01

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.