4 papers · 1 filter
Exploring compressibility of transformer based text-to-music (TTM) models
Vasileios Moschopoulos, Thanasis Kotsiopoulos, Pablo Peso Parada +7
State-of-the art Text-To-Music (TTM) generative AI models are large and require desktop or server class compute, making them infeasible for deployment on mobile phones. This paper…
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation
Jie Xu, Karthikeyan Saravanan, Rogier van Dalen +3
Federated learning (FL) allows clients to collaboratively train a global model without sharing their local data with a server. However, clients' contributions to the server can sti…
Locality enhanced dynamic biasing and sampling strategies for contextual ASR
Md Asif Jalal, Pablo Peso Parada, George Pavlidis +8
Automatic Speech Recognition (ASR) still face challenges when recognizing time-variant rare-phrases. Contextual biasing (CB) modules bias ASR model towards such contextually-releva…
Consistency Based Unsupervised Self-training For ASR Personalisation
Jisi Zhang, Vandana Rajan, Haaris Mehmood +7
On-device Automatic Speech Recognition (ASR) models trained on speech data of a large population might underperform for individuals unseen during training. This is due to a domain…