2 citations · 4 across the 3 of their papers we have counts for
3 papers
cs.LG2024★ 2 cited
LASER: Attention with Exponential Transformation
Sai Surya Duvvuri, Inderjit S. Dhillon
Transformers have had tremendous impact for several sequence related tasks, largely due to their ability to retrieve from any part of the sequence via softmax based dot-product att…
cs.LG2024
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
Jui-Nan Yen, Si Si, Zhao Meng +5
Low-rank adaption (LoRA) is a widely used parameter-efficient finetuning method for LLM that reduces memory requirements. However, current LoRA optimizers lack transformation invar…
cs.AI2024★ 2 cited
Large Language Models are Interpretable Learners
Ruochen Wang, Si Si, Felix Yu +3
The trade-off between expressiveness and interpretability remains a core challenge when building human-centric predictive models for classification and decision-making. While symbo…