Towards Efficient Post-Training via Fourier-Driven Adapter Architectures

Donggyun Bae, Jongil Park

We propose a novel framework, termed Fourier-Activated Adapter (FAA), for parameter-efficient fine-tuning of large pre-trained language models. By incorporating random Fourier feat…