Multi-Headed Transformer Architectures as Time-dependent Wasserstein Gradient Flows

Alex Massucco, Leonardo Del Grande, Marcello Carioni +2

In recent years, transformer architectures have revolutionized the field of language processing, opening the door to previously unforeseen possibilities. However, from a theoretica…