Communication Efficient Split Learning of ViTs with Attention-based Double Compression

Federico Alvetreti, Jary Pomponi, Paolo Di Lorenzo +1

This paper proposes a novel communication-efficient Split Learning (SL) framework, named Attention-based Double Compression (ADC), which reduces the communication overhead required…