Retrofitting Recurrent Vision-Language Models from Pretrained Backbones

Madhav Iyengar, Andreas Geiger, Hilde Kühne

Recent work shows that depth recurrence can be retrofitted into pretrained language models. In this work, we adapt this paradigm for visual understanding, using depth recurrence to…