03 · How Models Learn
SGD
Stochastic Gradient Descent
The fundamental training algorithm. It nudges weights a little at a time in the direction that reduces error, using small random batches. Picture rolling downhill toward the lowest point of an “error landscape.”
Concrete example
Each tiny step makes the model slightly less wrong; millions of steps later, it's good.