Skip to content

LLM Post-Training

Adapting pre-trained LLMs: supervised fine-tuning, parameter-efficient methods, preference optimization and alignment.

Topics I plan to document: SFT, LoRA, QLoRA, DoRA, preference optimization (DPO, KTO, ORPO), RLHF, reward models, alignment and evaluation.

The first courses and notes of this track are coming soon.