Engineering notes

Recent writing

1. 01

   Part 1 of 20

   Transformers from the Weights Up, Part 1: The 30,000-Foot View

   Text in, token out, and what a 50 GB weights file really is

   1 Nov 2026

2. 02

   Part 2 of 20

   Transformers from the Weights Up, Part 2: Dot products, the neuron, and shapes

   x·w as similarity and projection, and every layer as tensors flowing through matmuls.

   1 Nov 2026