AIAny
AI Infra2022
Icon for item

NVIDIA Warp

Compiles plain Python functions into GPU or CPU kernels at runtime via a JIT decorator, with differentiable output that plugs into PyTorch, JAX, and Paddle. Ships physics, robotics, geometry, and FEM primitives — particles, meshes, ray-casting, FFT.

Introduction

Writing GPU kernels usually means leaving Python for CUDA C++ and losing the gradient on the way out. Warp keeps you in Python: decorate a function with @wp.kernel and it JIT-compiles to native CPU or GPU code that stays differentiable end-to-end, so the same simulation you run forward can also backpropagate.

What Sets It Apart
  • Differentiability is first-class, not bolted on. Kernel gradients flow into PyTorch, JAX, and Paddle, so a physics step becomes just another differentiable layer in a training loop — directly useful for sim-to-real and gradient-based control.
  • Simulation primitives ship in the box. Particles, meshes, ray-casting, FFT, and finite-element methods are built in, so you don't assemble a scientific-computing stack before writing the actual model.
  • One source, two targets. The same kernel runs on CPU or GPU without a rewrite, and USD output drops results straight into standard visualization pipelines.
Who It's For

Great fit if you work on robotics, physics-based ML, or differentiable simulation and want gradients through GPU code without dropping to CUDA. Look elsewhere if you expect a high-level physics engine with ready-made rigid-body scenes — Warp is a kernel-authoring layer, so you build the simulation logic yourself, and reaching peak throughput still rewards understanding how the GPU executes your code.

Information

  • Websitegithub.com
  • AuthorsNVIDIA
  • Published date2022/03/18

More Items

Proposes VLAct, a representation-centric continued pre-training method for Vision-Language-Action models that preserves VLM priors and enforces cross-embodiment action semantics to turn limited robot trajectories into transferable visual-action representations; shows strong gains and sample efficiency on multiple VLA benchmarks using modest compute.

Provides a real-scale 3D Hong Kong sandbox to evaluate whether multimodal LLM agents can turn local street-view perception into sustained spatial action, supporting closed-loop first-person interaction, an interactive map, and controlled tests of grounding, long-range navigation, and robustness.

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.