03 · How Models Learn
Adam
Adaptive Moment Estimation
A widely used optimizer that adapts update sizes using running estimates of gradient behavior. Adam and variants such as AdamW are common defaults, although other optimizers are used.
Concrete example
If you read a training recipe, the optimizer line almost always says Adam (or a close variant).