24 citations · 45 across the 3 of their papers we have counts for
4 papers
MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs
Ziheng Jiang, Haibin Lin, Yinmin Zhong +29
We present the design, implementation and engineering experience in building and deploying MegaScale, a production system for training large language models (LLMs) at the scale of…
Monolith: Real Time Recommendation System With Collisionless Embedding Table
Zhuoran Liu, Leqi Zou, Xuan Zou +8
Building a scalable and real-time recommendation system is vital for many businesses driven by time-sensitive customer feedback, such as short-videos ranking or online ads. Despite…
CowClip: Reducing CTR Prediction Model Training Time from 12 hours to 10 minutes on 1 GPU
Zangwei Zheng, Pengtai Xu, Xuan Zou +12
The click-through rate (CTR) prediction task is to predict whether a user will click on the recommended item. As mind-boggling amounts of data are produced online daily, accelerati…
DiscoverFriends: Secure Social Network Communication in Mobile Ad Hoc Networks
Joshua Joy, Eric Chung, Zengwen Yuan +3
This paper presents a secure communication application called DiscoverFriends. Its purpose is to securely communicate to a group of online friends while bypassing their respective…