4 papers
Workload-Aware Hardware Accelerator Mining for Distributed Deep Learning Training
Muhammad Adnan, Amar Phanishayee, Janardhan Kulkarni +2
In this paper, we present a novel technique to search for hardware architectures of accelerators optimized for end-to-end training of deep neural networks (DNNs). Our approach addr…
Accelerating Recommender Model Training by Dynamically Skipping Stale Embeddings
Yassaman Ebrahimzadeh Maboud, Muhammad Adnan, Divya Mahajan +1
Training recommendation models pose significant challenges regarding resource utilization and performance. Prior research has proposed an approach that categorizes embeddings into…
Ad-Rec: Advanced Feature Interactions to Address Covariate-Shifts in Recommendation Networks
Muhammad Adnan, Yassaman Ebrahimzadeh Maboud, Divya Mahajan +1
Recommendation models are vital in delivering personalized user experiences by leveraging the correlation between multiple input features. However, deep learning-based recommendati…
FLuID: Mitigating Stragglers in Federated Learning using Invariant Dropout
Irene Wang, Prashant J. Nair, Divya Mahajan
Federated Learning (FL) allows machine learning models to train locally on individual mobile devices, synchronizing model updates via a shared server. This approach safeguards user…