Fine-tuning Multimodal Transformers on Edge: A Parallel Split Learning Approach

Timo Fudala, Vasileios Tsouvalas, Nirvana Meratnia

Multimodal transformers integrate diverse data types like images, audio, and text, advancing tasks such as audio-visual understanding and image-text retrieval; yet their high param…