AIAny
AI Train2020
Icon for item

NeuralOperator: Learning in Infinite Dimensions

PyTorch library for operator learning: neural networks that map between whole function spaces, not fixed grids, so a model trained at one resolution runs at any other. Bundles FNO, Tensorized FNO and related architectures, mainly for solving PDEs.

Introduction

Standard deep nets learn a mapping tied to one mesh; change the grid resolution and accuracy collapses. Neural operators remove that constraint — they learn the map between function spaces itself, so a model trained on coarse data can be evaluated on a finer grid with no retraining. This library is the reference implementation of that idea, now part of the official PyTorch Ecosystem.

What Sets It Apart
  • Resolution invariance is the headline: train at 64x64, infer at 256x256, because the learned object is a function-to-function map, not a grid-to-grid one — cheap training, high-fidelity inference.
  • Beyond the original Fourier Neural Operator (FNO), it ships Tensorized FNO (TFNO), whose Tucker factorization cuts parameters to roughly 10% of a dense FNO, so large operators fit on modest hardware.
  • It is built as tested, documented infrastructure rather than a research-paper dump: standardized training loops, benchmark datasets, and extensible layers for composing new operators.
Where It Comes From

Maintained jointly by NVIDIA and Caltech — the groups behind the original neural-operator papers — it consolidates years of scattered research code into one maintained package. The lineage matters: these are the architectures the field actually cites and builds on.

Great Fit If / Look Elsewhere If

Great fit if you work on PDE surrogates — weather, fluids, climate, materials — and want resolution-flexible models with a gentle on-ramp. Look elsewhere if your task is ordinary finite-dimensional supervised learning, or you need certified simulation accuracy: neural operators are learned approximators, not validated numerical solvers, and spectral layers can be memory-hungry at high mode counts.

Information

  • Websitegithub.com
  • OrganizationsNVIDIA, Caltech
  • AuthorsNeuralOperator (GitHub organization)
  • Published date2020/10/13

Categories

More Items

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub
AI Train2026

Provides a one-command CLI to fine-tune and post-train LLMs, with layer streaming that lets an 8B model be fine-tuned on a 4 GB laptop GPU. Auto-configures quantization, LoRA adapters, batching and evaluation gates, and supports export and serving workflows.

GitHub
AI Train2025

A PyTorch DTensor-native SPMD library for training and fine-tuning LLMs, VLMs, diffusion and retrieval models. Integrates with Hugging Face for day-0 model support, provides YAML-driven recipes, DTensor/FSDP2 parallelism and NVIDIA-optimized kernels (Transformer Engine, DeepEP, FlexAttn).