03 · How Models Learn

SFT

Supervised Fine-Tuning

After pre-training, you fine-tune on curated examples of good behaviour (high-quality question-answer pairs). This teaches the raw model to actually follow instructions and respond helpfully rather than just continue text.

Concrete example

Thousands of model answers written or vetted by people, used to turn a text-completer into something that answers questions.