CAMformer: Associative Memory is All You Need

Tergel Molom-Ochir, Benjamin F. Morris, Mark Horton +8

Transformers face scalability challenges due to the quadratic cost of attention, which involves dense similarity computations between queries and keys. We propose CAMformer, a nove…