Analog In-Memory Computing Attention Mechanism for Fast and Energy-Efficient Large Language Models

Nathan Leroux, Paul-Philipp Manea, Chirag Sudarshan +4

Transformer networks, driven by self-attention, are central to Large Language Models. In generative Transformers, self-attention uses cache memory to store token projections, avoid…