241 citations · 241 across the 5 of their papers we have counts for
1 paper · 1 filter
Fabio Pasqualetti, Taosha Guo
We address transformer attention on energy-constrained physical substrates. Softmax attention requires exponentiation and global reduction, operations with high energy cost on von…