10 papers
Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving
Yasmin Moslem, Magdalena Kacmajor, Vasudevan Nedumpozhimana +11
Efficient deployment of large language models (LLMs) in production forces a trade-off between accuracy and cost. Operators often default to a single model that is either expensive…
One Voice, Many Tongues: Cross-Lingual Voice Cloning for Scientific Speech
Amanuel Gizachew Abebe, Yasmin Moslem
Preserving a speaker's voice identity while generating speech in a different language remains a fundamental challenge in spoken language technology, particularly in specialized dom…
Dynamic Model Routing and Cascading for Efficient LLM Inference: A Survey
Yasmin Moslem, John D. Kelleher
The rapid growth of large language models (LLMs) with diverse capabilities, costs, and domains has created a critical need for intelligent model selection at inference time. While…
AfriNLLB: Efficient Translation Models for African Languages
Yasmin Moslem, Aman Kassahun Wassie, Amanuel Gizachew Abebe
In this work, we present AfriNLLB, a series of lightweight models for efficient translation from and into African languages. AfriNLLB supports 15 language pairs (30 translation dir…
Iterative Layer Pruning for Efficient Translation Inference
Yasmin Moslem, Muhammad Hazim Al Farouq, John D. Kelleher
Large language models (LLMs) have transformed many areas of natural language processing, including machine translation. However, efficient deployment of LLMs remains challenging du…
Efficient Speech Translation through Model Compression and Knowledge Distillation
Yasmin Moslem
Efficient deployment of large audio-language models for speech translation remains challenging due to their significant computational requirements. In this paper, we address this c…