10 citations · 26 across the 18 of their papers we have counts for
6 papers · 1 filter
Practical and Private Hybrid ML Inference with Fully Homomorphic Encryption
Sayan Biswas, Philippe Chartier, Akash Dhasade +7
In contemporary cloud-based services, protecting users' sensitive data and ensuring the confidentiality of the server's model are critical. Fully homomorphic encryption (FHE) enabl…
HarMoEny: Efficient Multi-GPU Inference of MoE Models
Zachary Doucet, Rishi Sharma, Martijn de Vos +3
Mixture-of-Experts (MoE) models offer computational efficiency during inference by activating only a subset of specialized experts for a given input. This enables efficient model s…
Robust ML Auditing using Prior Knowledge
Jade Garcia Bourrée, Augustin Godinot, Martijn De Vos +5
Among the many technical challenges to enforcing AI regulations, one crucial yet underexplored problem is the risk of audit manipulation. This manipulation occurs when a platform d…
Accelerating MoE Model Inference with Expert Sharding
Oana Balmau, Anne-Marie Kermarrec, Rafael Pires +3
Mixture of experts (MoE) models achieve state-of-the-art results in language modeling but suffer from inefficient hardware utilization due to imbalanced token routing and communica…
Practical Federated Learning without a Server
Akash Dhasade, Anne-Marie Kermarrec, Erick Lavoie +3
Federated Learning (FL) enables end-user devices to collaboratively train ML models without sharing raw data, thereby preserving data privacy. In FL, a central parameter server coo…
Efficient Federated Search for Retrieval-Augmented Generation using Lightweight Routing
Akash Dhasade, Rachid Guerraoui, Anne-Marie Kermarrec +4
Large language models (LLMs) achieve remarkable performance across domains but remain prone to hallucinations and inconsistencies. Retrieval-augmented generation (RAG) mitigates th…