34 citations · 69 across the 18 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024★ 14 cited
A Survey on Transformer Compression
Yehui Tang, Yunhe Wang, Jianyuan Guo +4
Transformer plays a vital role in the realms of natural language processing (NLP) and computer vision (CV), specially for constructing large language models (LLM) and large vision…
cs.LG2021★ 10 cited
How Well Does Self-Supervised Pre-Training Perform with Streaming Data?
Dapeng Hu, Shipeng Yan, Qizhengqiu Lu +6
Prior works on self-supervised pre-training focus on the joint training scenario, where massive unlabeled data are assumed to be given as input all at once, and only then is a lear…