Preference Tuning & RL

Supervised fine-tuning teaches a model what good answers look like. Preference tuning teaches it which answer is better when several answers are plausible. This course follows the field's paper lineage—InstructGPT, DPO, DeepSeek-R1—and covers RLHF, DPO, GRPO, reward models, and the eval work needed before you ship.