MoLT: Mixture of Layer-Wise Tokens for Efficient Audio-Visual Learning

Kyeongha Rho, Hyeongkeun Lee, Jae Won Cho +1

In this paper, we propose Mixture of Layer-Wise Tokens (MoLT), a parameter- and memory-efficient adaptation framework for audio-visual learning. The key idea of MoLT is to replace…