28 citations · 43 across the 22 of their papers we have counts for
Showing 2024 · cs.LGShow all
3 papers · 2 filters
cs.LG2024
Towards Faster Graph Partitioning via Pre-training and Inductive Inference
Meng Qin, Chaorui Zhang, Yu Gao +5
Graph partitioning (GP) is a classic problem that divides the node set of a graph into densely-connected blocks. Following the IEEE HPEC Graph Challenge and recent advances in pre-…
cs.LG2024
A Mean Field Ansatz for Zero-Shot Weight Transfer
Xingyuan Chen, Wenwei Kuang, Lei Deng +3
The pre-training cost of large language models (LLMs) is prohibitive. One cutting-edge approach to reduce the cost is zero-shot weight transfer, also known as model growth for some…
cs.LG2024★ 1 cited
Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory
Xueyan Niu, Bo Bai, Lei Deng +1
Increasing the size of a Transformer does not always lead to enhanced performance. This phenomenon cannot be explained by the empirical scaling laws. Furthermore, the model's enhan…