Semantic Allocation in Ordered Bottlenecks: Predictive Residual Inference for Visual Representation Learning

Erik Ayari, Manuel Traub, Martin V. Butz

Ordered bottlenecks aim to provide utility at flexible budgets by assigning coarse information to early tokens and task-relevant detail to later ones. Prior work, including tail dr…