3 papers
cs.CL2025
Privacy-Preserving Transformers: SwiftKey's Differential Privacy Implementation
Abdelrahman Abouelenin, Mohamed Abdelrehim, Raffy Fahim +2
In this paper we train a transformer using differential privacy (DP) for language modeling in SwiftKey. We run multiple experiments to balance the trade-off between the model size,…
cs.CL2025
On-Device Emoji Classifier Trained with GPT-based Data Augmentation for a Mobile Keyboard
Hossam Amer, Joe Osborne, Michael Zaki +1
Emojis improve communication quality among smart-phone users that use mobile keyboards to exchange text. To predict emojis for users based on input text, we should consider the on-…
cs.AI2024
Simply Trainable Nearest Neighbour Machine Translation with GPU Inference
Hossam Amer, Abdelrahman Abouelenin, Mohamed Maher +3
Nearest neighbor machine translation is a successful approach for fast domain adaption, which interpolates the pre-trained transformers with domain-specific token-level k-nearest-n…