Harnessing Attention Mechanisms: Efficient Sequence Reduction using Attention-based Autoencoders

Daniel Biermann, Fabrizio Palumbo, Morten Goodwin +1

Many machine learning models use the manipulation of dimensions as a driving force to enable models to identify and learn important features in data. In the case of sequential data…