Low-Rank Updates: Preparing for the Tinker Guest Session | Stanford CS224N Lecture 18
Work through a low-rank update, distinguish update rank from full-weight rank, and count trainable parameters. This preparation follows the LoRA paper and does not reconstruct the unavailable guest session.