Skip to content
All tags

#rlvr

2 posts
ai deep-dive Reading Stanford CS336

CS336 Lecture 16: RLVR Scales Reasoning with Verifiable Rewards, but GRPO Is Not Free PPO

Lecture 16 moves from PPO to GRPO and RLVR. Math, code, and environment outcomes provide scalable rewards and avoid some preference-model overoptimization, but group-normalized advantages introduce difficulty and length bias while rollout infrastructure becomes the dominant cost.

#cs336#rlvr#grpo#reasoning#reinforcement-learning
ai deep-dive Reading Stanford CS229

Reasoning in LLMs: Chain of Thought and Long-Reasoning RLVR

Chapter 18 separates two levers for LLM reasoning: chain of thought adds test-time computation, while verifiable rewards and policy gradients train long-reasoning behavior.

#cs229#llm-reasoning#chain-of-thought#rlvr#ppo