Series

Longer explorations split into ordered parts. Read them in sequence for the full picture.

🤖

Understanding Transformers

machine-learning deep-learning nlp

A ground-up exploration of the Transformer architecture — from basic attention to modern LLMs. Each part builds on the previous.

  1. 1 Understanding Transformers — Part 1: The Attention Mechanism
  2. 2 Understanding Transformers — Part 2: Multi-Head Attention
  3. 3 Understanding Transformers — Part 3: Positional Encoding
📚

Book Notes: Rationality & Decision-Making

books rationality cognitive-science

Notes and reflections across books on human judgment, cognitive biases, and rational thinking.

  1. 1 Book Notes: Thinking, Fast and Slow