AIAny

The perceptron: a probabilistic model for information storage and organization in the brain

Models the brain probabilistically and proposes the perceptron: weighted threshold units that learn to classify patterns by adjusting connection strengths from examples, rather than storing fixed memories. The 1958 root of trainable neural networks.

Introduction

Before this paper, the dominant question about memory was where the brain stores a coded copy of each thing it learns. Rosenblatt's move was to stop asking that. He argued recognition needs no stored copies at all — it can emerge statistically from how a network of simple threshold units wires itself up through exposure. Learning becomes a change in connection strengths, not the filing of a symbol.

Key Findings
  • Memory as connectivity, not storage. Information lives in the weights between units, distributed across the network — there is no address where a given memory sits. This reframed memory from retrieval to reconstruction.
  • Learning from examples, probabilistically. The perceptron adjusts weights from labeled inputs and generalizes to unseen patterns, with behavior described in statistical rather than logical terms — a sharp break from the symbolic AI forming at the same moment.
  • A physical, trainable mechanism. Rosenblatt specified something buildable, not a metaphor. The Mark I hardware that followed made "a machine that learns" literal, which is why the paper reads as the starting line for neural networks.
Why It Still Matters — and Where It Broke

Great fit if you want the conceptual origin of every modern neural net: backprop, deep learning, and large models all inherit the weights-as-memory idea introduced here. Read it for lineage, not technique. Look elsewhere for working methods — the single-layer perceptron cannot learn non-linearly-separable functions like XOR, the limitation Minsky and Papert formalized in 1969. That critique helped freeze the field for over a decade until multi-layer networks and backpropagation answered it. The vision was right; the 1958 mechanism was only the first layer of it.

Information

  • Websitewww.ling.upenn.edu
  • OrganizationsCornell Aeronautical Laboratory
  • AuthorsFrank Rosenblatt
  • Published date1958/01/01

More Items

Enables multi-head, depth-wise residual retrieval in Transformers by expanding a single residual stream into multiple context-aware streams using causal depthwise convolutions. Improves pretraining convergence and downstream benchmark scores with minimal overhead, yielding notable iso-loss compute speedups in large MoE models.

A concise textbook-style book that explains foundational concepts and techniques for large language models, covering pre-training, generative models, prompting, alignment, inference, and reasoning. Structured as self-contained chapters for readers with some ML/NLP background or those seeking a principled introduction to LLM foundations.

Analyzes why self-evolving reasoning models collapse under repeated self-training and proposes R-Quest: a feedback-driven pipeline that trains solvers to reject invalid questions and uses a frozen base model to detect task-level repetition, filtering training data to sustain multi-round gains.