7 citations · 7 across the 3 of their papers we have counts for
3 papers
cs.LG2023
Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models
Daochen Zha, Louis Feng, Liang Luo +8
Sharding a large machine learning model across multiple devices to balance the costs is important in distributed training. This is challenging because partitioning is NP-hard, and…
cs.LG2022★ 7 cited
DreamShard: Generalizable Embedding Table Placement for Recommender Systems
Daochen Zha, Louis Feng, Qiaoyu Tan +6
We study embedding table placement for distributed recommender systems, which aims to partition and place the tables on multiple hardware devices (e.g., GPUs) to balance the comput…
cs.LG2022
AutoShard: Automated Embedding Table Sharding for Recommender Systems
Daochen Zha, Louis Feng, Bhargav Bhushanam +7
Embedding learning is an important technique in deep recommendation models to map categorical features to dense vectors. However, the embedding tables often demand an extremely lar…