Dissecting Multiplication in Transformers: Insights into LLMs

Luyu Qiu, Jianing Li, Chi Su +2

Transformer-based large language models have achieved remarkable performance across various natural language processing tasks. However, they often struggle with seemingly easy task…