AIAny
Icon for item

Newton

GPU-accelerated physics simulation engine for robotics and simulation research — built on NVIDIA Warp with MuJoCo Warp backend, offering differentiable simulation, OpenUSD support, and extensions for RL/embodied-AI workflows. ([github.com](https://github.com/newton-physics/newton))

Introduction

Why this matters

Modern robotics and embodied-AI experiments increasingly rely on fast, differentiable, and scalable simulation to iterate policies and learn from large batches of rollouts. Newton is designed to put those capabilities on the GPU stack by extending NVIDIA Warp and integrating MuJoCo Warp, so researchers can run large, GPU-parallel physics workloads and use differentiability where needed. (github.com)

What Sets It Apart
  • GPU-first architecture: Extends Warp’s simulation primitives to maximize on-GPU computation and parallelism, reducing CPU–GPU transfer overheads and enabling many simultaneous environments for RL and system identification. This matters when you want thousands of parallel rollouts or large batch differentiable computations. (github.com)
  • Differentiability and extensibility: Built with differentiable components and user-defined extensibility in mind, so gradient-based optimization (e.g., system identification, differentiable control) is supported rather than an afterthought. (github.com)
  • Integration and ecosystem signals: Uses MuJoCo Warp as a primary backend, supports OpenUSD for scene and asset workflows, and was initiated with contributions from Disney Research, DeepMind, and NVIDIA — positioning it for robotics research pipelines that need reproducible, production-grade simulation. (github.com)
Who It's For — Tradeoffs

Great fit if you are a robotics or RL researcher who needs GPU-parallel, differentiable simulation for training or evaluation at scale. It’s also suitable for simulation researchers who want OpenUSD-compatible scene workflows and extensible physics modules.

Look elsewhere if you need a CPU-only, lightweight physics engine (Newton targets NVIDIA GPUs and CUDA), or if your deployment environment forbids GPU acceleration or requires strict commercial licensing beyond Apache-2.0. macOS runs are CPU-only and some advanced GPU features require recent NVIDIA drivers/CUDA. (github.com)

Where It Fits

Positioned between low-level GPU physics research code and heavyweight commercial simulators: it’s an open-source option for teams that want a GPU-native, research-oriented simulation stack that integrates with modern asset pipelines (OpenUSD) and supports differentiable workflows used in embodied-AI and RL experiments. (github.com)

Information

  • Websitegithub.com
  • AuthorsThe Newton Contributors, Disney Research, Google DeepMind, NVIDIA
  • Published date2025/04/22

Categories

More Items

Analyzes adversarial weaknesses of World-Action Models (WAMs) via BadWAM, a framework that crafts visual perturbations to decouple a model’s imagined future from its executed actions. Introduces two attack modes—action-only (disruptive) and imagination-preserving (stealthy)—and shows large drops in closed-loop task success (e.g., 96.5%→43.1%).

Provides a deliberative Agent OS layer for robots that handles scene-conditioned planning, context-isolated skill execution, multi-stage verification, persistent multi-modal graph memory, and edge–cloud collaboration. Introduces EmbodiedWorldBench (16 scenes, 200+ tasks) and a failure-driven self-evolution loop; shows improved task success and strong memory benchmark scores.

Unifies high-level visual-language reasoning and low-level control for visual navigation by decoupling cognition and control: a slow vision-language reasoner produces pixel goals with explicit chain-of-thought, and a fast action expert converts those anchors into continuous waypoints for robust urban and indoor navigation.