Skip to content

LLM From Scratch

Understanding and implementing the fundamental components of modern Large Language Models from first principles.

This track documents how I build a GPT-style language model step by step: tokenization, embeddings, attention, the transformer block, training and generation. Each module note records what I learned, my own implementation and what I still need to understand.

The first courses and notes of this track are coming soon.