Aller au contenu

LLM From Scratch

Understanding and implementing the fundamental components of modern Large Language Models from first principles.

This track documents how I build a GPT-style language model step by step: tokenization, embeddings, attention, the transformer block, training and generation. Each module note records what I learned, my own implementation and what I still need to understand.

Les premiers cours et notes de ce track arrivent bientôt.