AIAny
Icon for item

Newton

GPU-accelerated physics simulation engine for robotics and simulation research — built on NVIDIA Warp with MuJoCo Warp backend, offering differentiable simulation, OpenUSD support, and extensions for RL/embodied-AI workflows. ([github.com](https://github.com/newton-physics/newton))

Introduction

Why this matters

Modern robotics and embodied-AI experiments increasingly rely on fast, differentiable, and scalable simulation to iterate policies and learn from large batches of rollouts. Newton is designed to put those capabilities on the GPU stack by extending NVIDIA Warp and integrating MuJoCo Warp, so researchers can run large, GPU-parallel physics workloads and use differentiability where needed. (github.com)

What Sets It Apart
  • GPU-first architecture: Extends Warp’s simulation primitives to maximize on-GPU computation and parallelism, reducing CPU–GPU transfer overheads and enabling many simultaneous environments for RL and system identification. This matters when you want thousands of parallel rollouts or large batch differentiable computations. (github.com)
  • Differentiability and extensibility: Built with differentiable components and user-defined extensibility in mind, so gradient-based optimization (e.g., system identification, differentiable control) is supported rather than an afterthought. (github.com)
  • Integration and ecosystem signals: Uses MuJoCo Warp as a primary backend, supports OpenUSD for scene and asset workflows, and was initiated with contributions from Disney Research, DeepMind, and NVIDIA — positioning it for robotics research pipelines that need reproducible, production-grade simulation. (github.com)
Who It's For — Tradeoffs

Great fit if you are a robotics or RL researcher who needs GPU-parallel, differentiable simulation for training or evaluation at scale. It’s also suitable for simulation researchers who want OpenUSD-compatible scene workflows and extensible physics modules.

Look elsewhere if you need a CPU-only, lightweight physics engine (Newton targets NVIDIA GPUs and CUDA), or if your deployment environment forbids GPU acceleration or requires strict commercial licensing beyond Apache-2.0. macOS runs are CPU-only and some advanced GPU features require recent NVIDIA drivers/CUDA. (github.com)

Where It Fits

Positioned between low-level GPU physics research code and heavyweight commercial simulators: it’s an open-source option for teams that want a GPU-native, research-oriented simulation stack that integrates with modern asset pipelines (OpenUSD) and supports differentiable workflows used in embodied-AI and RL experiments. (github.com)

Information

  • Websitegithub.com
  • AuthorsThe Newton Contributors, Disney Research, Google DeepMind, NVIDIA
  • Published date2025/04/22

Categories

More Items

Proposes VLAct, a representation-centric continued pre-training method for Vision-Language-Action models that preserves VLM priors and enforces cross-embodiment action semantics to turn limited robot trajectories into transferable visual-action representations; shows strong gains and sample efficiency on multiple VLA benchmarks using modest compute.

Provides a real-scale 3D Hong Kong sandbox to evaluate whether multimodal LLM agents can turn local street-view perception into sustained spatial action, supporting closed-loop first-person interaction, an interactive map, and controlled tests of grounding, long-range navigation, and robustness.

Generates enterable omnimodal world-model rollouts that follow continuous 6-DoF camera control while jointly producing 720p video, environmental sound, music and speech. Uses dataset-level motion calibration, a specialized data engine, progressive training and autoregressive post-training to support long-horizon first- and third-person interaction.