AIAny
GitHub

Newton

GPU-accelerated physics simulation engine for robotics and simulation research — built on NVIDIA Warp with MuJoCo Warp backend, offering differentiable simulation, OpenUSD support, and extensions for RL/embodied-AI workflows. ([github.com](https://github.com/newton-physics/newton))

Introduction

Why this matters

Modern robotics and embodied-AI experiments increasingly rely on fast, differentiable, and scalable simulation to iterate policies and learn from large batches of rollouts. Newton is designed to put those capabilities on the GPU stack by extending NVIDIA Warp and integrating MuJoCo Warp, so researchers can run large, GPU-parallel physics workloads and use differentiability where needed. (github.com)

What Sets It Apart
  • GPU-first architecture: Extends Warp’s simulation primitives to maximize on-GPU computation and parallelism, reducing CPU–GPU transfer overheads and enabling many simultaneous environments for RL and system identification. This matters when you want thousands of parallel rollouts or large batch differentiable computations. (github.com)
  • Differentiability and extensibility: Built with differentiable components and user-defined extensibility in mind, so gradient-based optimization (e.g., system identification, differentiable control) is supported rather than an afterthought. (github.com)
  • Integration and ecosystem signals: Uses MuJoCo Warp as a primary backend, supports OpenUSD for scene and asset workflows, and was initiated with contributions from Disney Research, DeepMind, and NVIDIA — positioning it for robotics research pipelines that need reproducible, production-grade simulation. (github.com)
Who It's For — Tradeoffs

Great fit if you are a robotics or RL researcher who needs GPU-parallel, differentiable simulation for training or evaluation at scale. It’s also suitable for simulation researchers who want OpenUSD-compatible scene workflows and extensible physics modules.

Look elsewhere if you need a CPU-only, lightweight physics engine (Newton targets NVIDIA GPUs and CUDA), or if your deployment environment forbids GPU acceleration or requires strict commercial licensing beyond Apache-2.0. macOS runs are CPU-only and some advanced GPU features require recent NVIDIA drivers/CUDA. (github.com)

Where It Fits

Positioned between low-level GPU physics research code and heavyweight commercial simulators: it’s an open-source option for teams that want a GPU-native, research-oriented simulation stack that integrates with modern asset pipelines (OpenUSD) and supports differentiable workflows used in embodied-AI and RL experiments. (github.com)

Information

  • Websitegithub.com
  • AuthorsThe Newton Contributors, Disney Research, Google DeepMind, NVIDIA
  • Published date2025/04/22

Categories

More Items

Trains a three-stage system that enables humanoid robots to visually perceive and reflexively catch thrown boxes using an egocentric RGB-D encoder, a compact latent object-dynamics representation, and a whole-body RL controller; reports 85.7% simulation success and 65%/40% real-world success at 2.5/5 m.

Generates synchronized egocentric video streams for multiple interacting agents in a shared environment, enforcing cross-view action consistency, shared environment memory, and consistent propagation of interaction-induced state changes — aimed at embodied AI, VR, and multi-agent vision research.

Lets a pretrained multimodal LLM interpret navigation requests and orchestrate motion via tool calls for generalist robot navigation across unfamiliar scenes. Key features: an agent harness with Navigation Skills, a unified visual-point interface, task-progress tracking, and tool-based motion execution without navigation-specific fine-tuning.