Adaptive Integrated Layered Attention (AILA)

William Claster, Suhas KM, Dhairya Gundechia

We propose Adaptive Integrated Layered Attention (AILA), a neural network architecture that combines dense skip connections with different mechanisms for adaptive feature reuse acr…