Showing 2024 · cs.LGShow all
2 papers · 2 filters
cs.LG2024
SFT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity
Xinyu Yang, Jixuan Leng, Geyang Guo +5
Current PEFT methods for LLMs can achieve either high quality, efficient training, or scalable serving, but not all three simultaneously. To address this limitation, we investigate…
cs.LG2024
VcLLM: Video Codecs are Secretly Tensor Codecs
Ceyu Xu, Yongji Wu, Xinyu Yang +4
As the parameter size of large language models (LLMs) continues to expand, the need for a large memory footprint and high communication bandwidth have become significant bottleneck…