420 citations · 902 across the 15 of their papers we have counts for
Showing 2023Show all
3 papers · 1 filter
cs.LG2023★ 21 cited
QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
Yuhui Xu, Lingxi Xie, Xiaotao Gu +6
Recently years have witnessed a rapid development of large language models (LLMs). Despite the strong ability in many language-understanding tasks, the heavy computational burden l…
cs.CV2023
Advancing Incremental Few-shot Semantic Segmentation via Semantic-guided Relation Alignment and Adaptation
Yuan Zhou, Xin Chen, Yanrong Guo +3
Incremental few-shot semantic segmentation (IFSS) aims to incrementally extend a semantic segmentation model to novel classes according to only a few pixel-level annotated data, wh…
cs.DC2023
Pipeline MoE: A Flexible MoE Implementation with Pipeline Parallelism
Xin Chen, Hengheng Zhang, Xiaotao Gu +3
The Mixture of Experts (MoE) model becomes an important choice of large language models nowadays because of its scalability with sublinear computational complexity for training and…