Path-Conditioned Attention Mobility: From Depth to Execution Hubs in SegFormer

Aleksandr Druzhinin

Transformer compression often couples two distinct quantities: retained attention capacity and the number of sequential depths at which that capacity is executed. We study whether…