4 papers
Robustness of Prompting: Enhancing Robustness of Large Language Models Against Prompting Attacks
Lin Mu, Guowei Chu, Li Ni +2
Large Language Models (LLMs) have demonstrated remarkable performance across various tasks by effectively utilizing a prompting strategy. However, they are highly sensitive to inpu…
GraphLoRA: Structure-Aware Low-Rank Adaptation for Large Language Model Recommendation
Lin Mu, Guoji Wang, Li Ni +4
Large Language Models (LLMs) have shown strong potential for recommendation (LLMRec) due to their powerful reasoning and generalization abilities. However, effectively aligning the…
TalkLoRA: Communication-Aware Mixture of Low-Rank Adaptation for Large Language Models
Lin Mu, Haiyang Wang, Li Ni +4
Low-Rank Adaptation (LoRA) enables parameter-efficient fine-tuning of Large Language Models (LLMs), and recent Mixture-of-Experts (MoE) extensions further enhance flexibility by dy…
DenseLoRA: Dense Low-Rank Adaptation of Large Language Models
Lin Mu, Xiaoyu Wang, Li Ni +4
Low-rank adaptation (LoRA) has been developed as an efficient approach for adapting large language models (LLMs) by fine-tuning two low-rank matrices, thereby reducing the number o…