4 papers
PAE MobiLLM: Privacy-Aware and Efficient LLM Fine-Tuning on the Mobile Device via Additive Side-Tuning
Xingke Yang, Liang Li, Zhiyi Wan +6
There is a huge gap between numerous intriguing applications fostered by on-device large language model (LLM) fine-tuning (FT) from fresh mobile data and the limited resources of a…
Do Protein Transformers Have Biological Intelligence?
Fudong Lin, Wanrou Du, Jinchan Liu +5
Deep neural networks, particularly Transformers, have been widely adopted for predicting the functional properties of proteins. In this work, we focus on exploring whether Protein…
Adaptive Budget Allocation for Orthogonal-Subspace Adapter Tuning in LLMs Continual Learning
Zhiyi Wan, Wanrou Du, Liang Li +2
Large language models (LLMs) often suffer from catastrophic forgetting in continual learning (CL) scenarios, where performance on previously learned tasks degrades severely while t…
Differential Privacy Preserving Distributed Quantum Computing
Hui Zhong, Keyi Ju, Jiachen Shen +5
Existing quantum computers can only operate with hundreds of qubits in the Noisy Intermediate-Scale Quantum (NISQ) state, while quantum distributed computing (QDC) is regarded as a…