Learning Decorrelated Representations Efficiently Using Fast Fourier Transform

Yutaro Shigeto, Masashi Shimbo, Yuya Yoshikawa +1

Barlow Twins and VICReg are self-supervised representation learning models that use regularizers to decorrelate features. Although these models are as effective as conventional rep…