6 citations · 9 across the 19 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.AI2024★ 1 cited
Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
Ermo Hua, Che Jiang, Xingtai Lv +7
Extending the context length of Language Models (LMs) by improving Rotary Position Embedding (RoPE) has become a trend. While prior works mainly address RoPE's limitations within a…
cs.AI2024
Automating Exploratory Proteomics Research via Language Models
Ning Ding, Shang Qu, Linhai Xie +13
With the development of artificial intelligence, its contribution to science is evolving from simulating a complex problem to automating entire research processes and producing nov…
cs.LG2024★ 6 cited
Improving LoRA in Privacy-preserving Federated Learning
Youbang Sun, Zitao Li, Yaliang Li +1
Low-rank adaptation (LoRA) is one of the most popular task-specific parameter-efficient fine-tuning (PEFT) methods on pre-trained language models for its good performance and compu…