Exploring Compositionality in Vision Transformers using Wavelet Representations

Akshad Shyam Purushottamdas, Pranav K Nayak, Divya Mehul Rajparia +4

While insights into the workings of the transformer model have largely emerged by analysing their behaviour on language tasks, this work investigates the representations learnt by…