Wandering off the main path.Side quests in machine learning — derived, coded and plotted from first principles.
Pixel art generation using discrete diffusion14 August 2026·824 words·4 minsLearning Diffusion Discrete-Diffusion Transformer Pixel-Art NotebookTraining a small transformer to generate 16x16 pixel art characters by de-masking pixels step by step.
Batch, layer, and group norm, side by side on MNIST31 July 2026·1082 words·6 minsLearning Normalization Normalization Batch Norm Layer Norm Group NormA simple MLP on MNIST to see how batch, layer, and group normalization differ in training speed, accuracy, and neuron activations.
Language generation with discrete diffusion17 July 2026·1233 words·6 minsLearning Diffusion Discrete-Diffusion Transformer NotebookBuilding a discrete diffusion transformer (DiT) from scratch and training it to generate Shakespeare-like text, one denoising jump at a time.
Guided diffusion explained with 2-D examples2 July 2026·823 words·4 minsLearning Diffusion Diffusion Flow-Matching Guidance Cfg Classifier Free GuidanceA follow-up to the 2-D diffusion notebook: steering generation with labels, from vanilla conditioning to classifier-free guidance.
Diffusion model explained with simple 2-D dataset29 June 2026·1160 words·6 minsLearning Diffusion Diffusion Flow-Matching Score-MatchingA trimmed, annotated companion to the 2-D diffusion notebook — with an ODE-vs-SDE sampling comparison.