Pre-training, SFT, RLHF: Three Stages That Turn a Text Predictor into a Useful Assistant
Every LLM goes through three training stages: pre-training reads the internet to learn language, SFT uses example conversations to learn the format, and RLHF uses human preferences to learn what a good answer looks like. The gap between a base model and a chat model is what the last two stages do.