CS224N Lecture 12: Decoding, DeepSeek-R1, and Reasoning Training
Lecture 12 shows that output policy is not a detail: greedy, beam, and sampling produce different text. It then moves from R1-Zero/R1 into PPO, GRPO, and DAPO, asking when longer reasoning actually helps.