LLM Post-Training
Adapting pre-trained LLMs: supervised fine-tuning, parameter-efficient methods, preference optimization and alignment.
Topics I plan to document: SFT, LoRA, QLoRA, DoRA, preference optimization (DPO, KTO, ORPO), RLHF, reward models, alignment and evaluation.
The first courses and notes of this track are coming soon.