CS224N Lecture 9: Prompting, LoRA, and Parameter-Efficient Adaptation
Lecture 9 compares prompting, pruning, LoRA, prompt tuning, and adapters. Each asks the same question: how many parameters must change, and how much task-specific state must be stored, to adapt a large pretrained model?