1.3k citations · 1.7k across the 26 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
Jui-Nan Yen, Si Si, Zhao Meng +5
Low-rank adaption (LoRA) is a widely used parameter-efficient finetuning method for LLM that reduces memory requirements. However, current LoRA optimizers lack transformation invar…
cs.AI2024★ 2 cited
Large Language Models are Interpretable Learners
Ruochen Wang, Si Si, Felix Yu +3
The trade-off between expressiveness and interpretability remains a core challenge when building human-centric predictive models for classification and decision-making. While symbo…