AIAny

Neural Message Passing for Quantum Chemistry

Recasts a scatter of competing graph-network designs as one message-passing recipe — propagate, aggregate, read out — then proves it on QM9, hitting chemical accuracy on most molecular property targets without hand-built descriptors.

Introduction

The lasting contribution here is not a single model but a vocabulary. Before this paper, "graph neural network" named a loose cluster of independently invented architectures that nobody could easily compare. By showing they were all special cases of one pattern — pass messages along edges, aggregate them at each node, read out a graph-level answer — it gave the field a shared API, and "message passing" became the default way people reason about learning on graphs.

Key Findings
  • Many models, one abstraction. Half a dozen prior graph architectures collapse into three pluggable functions (message, update, readout); choosing variants becomes an engineering search rather than reinventing the wheel.
  • Learned features beat hand-crafted descriptors. On QM9 molecular property prediction the framework reaches chemical accuracy on most of the targets, where chemists had previously relied on engineered molecular fingerprints.
  • The graph itself carries the chemistry. Atoms as nodes, bonds as edges, and a readout invariant to atom ordering let the network respect molecular symmetry without baking in physics by hand.
  • A bottleneck made explicit. The authors argue the benchmark is close to saturated, pointing future work toward larger molecules and more accurate labels rather than fancier models — a rare honest call on diminishing returns.
Why It Still Matters / When to Skip

Great fit if you want the conceptual origin of modern GNNs, or the cleanest mental model for why so many graph-learning papers describe themselves as "message passing." Look elsewhere if you need the current state of the art: attention-based and transformer-style graph models, plus large-scale molecular pretraining, all postdate this — it is the framework that organized the field, not the strongest model running today.

Information

  • Websitear5iv.labs.arxiv.org
  • OrganizationsGoogle Brain, Google, Google DeepMind
  • AuthorsJustin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl
  • Published date2017/04/04

More Items

Systematically studies how language and vision interact during unified multimodal pretraining, identifies mechanisms that enable modality synergy versus competition, demonstrates the benefit of early joint training, and derives efficient pretraining recipes validated at scale.

Presents Metis, a prototype memory foundation model that embeds a persistent native memory state into the backbone so historical experience is compressed and accessed via memory attention. Key features: forward-only, gradient-free online memory updates; memory-specific mid-training objectives; and a dual text/code memory design.

Empirically studies how transformer-based native multimodal pre-training scales under fixed compute, deriving compute- and data-allocation power laws and an efficiency frontier for model size, token count, and data mixture; evaluates cross-modal transfer and multimodal in-context learning.