Probabilistic Machine Learning: An Introduction

The book provides a comprehensive yet accessible introduction to probabilistic modeling and inference, covering topics like graphical models, Bayesian methods, and approximate inference. It balances theory with practical examples, making complex probabilistic concepts understandable for newcomers and useful for practitioners. Its impact lies in shaping how students and researchers approach uncertainty in machine learning, offering a unifying probabilistic perspective that has influenced research, teaching, and real-world applications across fields such as AI, robotics, and data science.

Visit Website

Introduction

Back

Information

Websiteprobml.github.io
AuthorsKevin Patrick Murphy
Published date2022/03/01

More Items

Machine Super Intelligence by Shane Legg

2011

Shane Legg

This book develops a formal theory of intelligence, defining it as an agent’s capacity to achieve goals across computable environments and grounding the concept in Kolmogorov complexity, Solomonoff induction and Hutter’s AIXI framework.It shows how these idealised constructs unify prediction, compression and reinforcement learning, yielding a universal intelligence measure while exposing the impracticality of truly optimal agents due to incomputable demands. Finally, it explores how approximate implementations could trigger an intelligence explosion and stresses the profound ethical and existential stakes posed by machines that surpass human capability.

foundation 30u30 book

Kolmogorov Complexity and Algorithmic Randomness

2022

A. Shen, V. A. Uspensky +1

This book offers a comprehensive introduction to algorithmic information theory: it defines plain and prefix Kolmogorov complexity, explains the incompressibility method, relates complexity to Shannon information, and develops tests of randomness culminating in Martin-Löf randomness and Chaitin’s Ω. It surveys links to computability theory, mutual information, algorithmic statistics, Hausdorff dimension, ergodic theory, and data compression, providing numerous exercises and historical notes. By unifying complexity and randomness, it supplies rigorous tools for measuring information content, proving combinatorial lower bounds, and formalizing the notion of random infinite sequences, thus shaping modern theoretical computer science.

foundation 30u30 book math

Understanding Deep Learning

2023

Simon J.D. Prince

The book offers a clear, intuitive introduction to deep learning, breaking down complex mathematical ideas into accessible explanations with vivid illustrations. It covers essential topics like neural networks, backpropagation, optimization, and modern architectures, making it ideal for newcomers and practitioners seeking conceptual clarity. Its impact lies in demystifying deep learning’s core principles, empowering a broad audience to engage with cutting-edge machine learning research and applications, and serving as a valuable bridge between foundational theory and practical implementation in the rapidly evolving AI landscape.

foundation book

The book builds on the author’s 2012 work(MLAPP), expanding coverage of machine learning through the lens of probabilistic modeling and Bayesian decision theory. Driven by the deep learning revolution, the author split the second edition into two volumes to include major advances like deep learning, generative models, variational inference, and reinforcement learning. The new edition is more student-friendly, adding background material, exercises, and Python-based code (instead of Matlab). Together, these two volumes aim to comprehensively reflect the state of ML as of 2021, offering both foundational and advanced insights.