04 · How Models Run

FP32 / FP16 / BF16

Floating-point precision formats

Higher-precision number formats used mostly in training. BF16 (“Brain Float”) is a Google-originated format popular for training stability.

Concrete example

Training often uses BF16; you'll see these formats named in technical model cards.