Understanding Probe Behaviors through Variational Bounds of Mutual Information

Kwanghee Choi, Jee-weon Jung, Shinji Watanabe

With the success of self-supervised representations, researchers seek a better understanding of the information encapsulated within a representation. Among various interpretability…