Enhancing Layer Interaction Using Key-Correlated Layer Attention

Jianlong Xiong, ChuanBo Xie, Le Yu +2

Recent advances in network architecture design have introduced layer attention to enhance inter-layer interactions. In such frameworks, each layer queries all preceding layers to e…