3 citations · 3 across the 8 of their papers we have counts for
4 papers · 1 filter
The Devil is in the Condition Numbers: Why is GLU Better than non-GLU Structure?
Xingyu Lyu, Qianqian Xu, Zhiyong Yang +2
Gated Linear Units (GLU) and their variants are widely adopted in modern open-source large language model architectures and consistently outperform their non-gated counterparts, ye…
Two Heads Are Better than One: Model-Weight and Latent-Space Analysis for Federated Learning on Non-iid Data against Poisoning Attacks
Xingyu Lyu, Ning Wang, Yang Xiao +4
Federated Learning is a popular paradigm that enables remote clients to jointly train a global model without sharing their raw data. However, FL has been shown to be vulnerable tow…
SSE-SAM: Balancing Head and Tail Classes Gradually through Stage-Wise SAM
Xingyu Lyu, Qianqian Xu, Zhiyong Yang +2
Real-world datasets often exhibit a long-tailed distribution, where vast majority of classes known as tail classes have only few samples. Traditional methods tend to overfit on the…
BoBa: Boosting Backdoor Detection through Data Distribution Inference in Federated Learning
Zhengyuan Jiang, Xingyu Lyu, Shanghao Shi +5
Federated learning, while being a promising approach for collaborative model training, is susceptible to backdoor attacks due to its decentralized nature. Backdoor attacks have sho…