Skip to content
ginsberg.si

Transformers from the Weights Up

Part 1: The 30,000-foot view and Part 2: Dot products, the neuron, and shapes are published. Later lessons show up here as their files are added.

Parts

  1. Part 1 of 20/1 Nov 2026

    Transformers from the Weights Up, Part 1: The 30,000-Foot View

    Text in, token out, and what a 50 GB weights file really is

  2. Part 2 of 20/1 Nov 2026

    Transformers from the Weights Up, Part 2: Dot products, the neuron, and shapes

    x·w as similarity and projection, and every layer as tensors flowing through matmuls.

Parts 3–20 are not written yet. Add them as sibling files in content/blog/transformers/ (part-2.mdx through part-20.mdx).