activity
20232026
most citedAccurate LoRA-Finetuning Quantization of LLMs via Information Retention

42 citations · 50 across the 9 of their papers we have counts for

collaborators
Showing 2023Show all

1 paper · 1 filter

cs.LG2023

RdimKD: Generic Distillation Paradigm by Dimensionality Reduction

Yi Guo, Yiqian He, Xiaoyang Li +4

Knowledge Distillation (KD) emerges as one of the most promising compression technologies to run advanced deep neural networks on resource-limited devices. In order to train a smal…