02 · Model Architectures
LSTM
Long Short-Term Memory
An RNN variant with internal gates that help decide what to retain, update, and forget, reducing some long-range dependency problems. LSTMs powered many sequence systems before Transformers became dominant.
Concrete example
Powered a generation of translation and speech tools just before the Transformer era.