Discover the Best AI Resources

Open Source Society University (OSSU) — Computer Science

Provides a complete, university-level computer science curriculum assembled from free online courses and books. Curates degree-aligned course sequences (Intro / Core / Advanced) with community support, project guidance, and checklists to track progress for self-directed learners.

Measures why complexity in closed systems rises then falls while entropy only climbs, using a coffee-and-cream cellular automaton. The key result: only interacting particles produce a transient complexity peak; non-interacting ones never do.

Frames generative modeling as a two-player game: a generator forges data while a discriminator learns to spot fakes, training both by backpropagation alone — no Markov chains, no inference networks. The adversarial pressure yields sharp samples.

First model to make a decoder dynamically focus on different source words instead of cramming a whole sentence into one fixed vector — the soft-alignment idea that became "attention" and, three years later, powered the Transformer.

A one-line fix that finally made dropout work with LSTMs: apply it only to the non-recurrent connections, leaving the memory path untouched. This let researchers train much larger RNNs without the overfitting that had capped their size.

Sequence to Sequence Learning with Neural Networks

End-to-end encoder–decoder using deep LSTMs to map variable-length input sequences to output sequences; demonstrated competitive English→French translation (BLEU 34.8) and improved optimization by reversing source sentences, showing strong handling of long sentences.

Apache Airflow

Programmatically author, schedule, and monitor data workflows as Python-defined DAGs; the scheduler handles dependencies, retries, and backfills. Pluggable executors (Local, Celery, Kubernetes) and a broad provider ecosystem for AWS, GCP, and databases.

Bolts a differentiable, addressable memory bank onto a neural network and trains the whole thing with gradient descent, letting it learn algorithms like copying, sorting, and recall from examples — a learned computer rather than a fixed circuit.

Stanford's course teaches deep learning by making you build vision models from scratch — k-NN and linear classifiers up through CNNs, detection, segmentation, and Transformers — with three PyTorch assignments and a self-chosen final project.

IPED

Processes and indexes seized digital evidence — disk images, files, timelines — for forensic examiners. Bundles high-speed carving, OCR, named-entity recognition, similar-image and face search, and audio transcription behind scriptable Java parsers.

Karpathy's 2015 walkthrough of character-level RNNs trained to predict the next character, showing how a tiny model learns to generate convincing Shakespeare, C code, and LaTeX — and what its neurons actually track.

Repurposes attention as a pointer that selects positions in the input rather than blending them into a context vector, so the output vocabulary can grow with input length — handling sorting, convex hulls, and TSP that fixed seq2seq cannot.