02 · Model Architectures
SSM
State Space Model
A newer architecture family (Mamba is the known example) pitched as an efficient alternative to Transformers for very long sequences. Worth knowing as the leading “what comes after Transformers” candidate — though Transformers still dominate.
Concrete example
Of interest when a task involves extremely long inputs where attention gets expensive.