9 citations · 50 across the 16 of their papers we have counts for
Showing 2023Show all
3 papers · 1 filter
cs.LG2023★ 2 cited
Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification
Lianke Qin, Zhao Song, Yuanyuan Yang
Deep learning has been widely used in many fields, but the model training process usually consumes massive computational resources and time. Therefore, designing an efficient neura…
cs.LG2023
Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Acceleration
Boyu Liu, Lianke Qin, Zhao Song +2
Submodular function maximization is a critical building block for diverse tasks, such as document summarization, sensor placement, and image segmentation. Yet its practical utility…
cs.LG2023★ 9 cited
Fast Attention Requires Bounded Entries
Josh Alman, Zhao Song
In modern machine learning, inner product attention computation is a fundamental task for training large language models such as Transformer, GPT-1, BERT, GPT-2, GPT-3 and ChatGPT.…