A Transformer-in-Transformer Network Utilizing Knowledge Distillation for Image Recognition

Dewan Tauhid Rahman, Yeahia Sarker, Antar Mazumder +1

This paper presents a novel knowledge distillation neural architecture leveraging efficient transformer networks for effective image classification. Natural images display intricat…