5 citations · 17 across the 14 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Confidence-Adaptive SwiGLU for Mixture-of-Experts
Shaohua Li, Xiuchao Sui, Xiaobing Sun +4
SwiGLU has become a standard gated activation in modern Transformer MLPs, yet its gate sharpness -- the smoothness and selectivity of the gating function -- is typically fixed thro…
cs.LG2024★ 5 cited
A New Perspective to Boost Performance Fairness for Medical Federated Learning
Yunlu Yan, Lei Zhu, Yuexiang Li +5
Improving the fairness of federated learning (FL) benefits healthy and sustainable collaboration, especially for medical applications. However, existing fair FL methods ignore the…
cs.LG2024
CPT: Consistent Proxy Tuning for Black-box Optimization
Yuanyang He, Zitong Huang, Xinxing Xu +5
Black-box tuning has attracted recent attention due to that the structure or inner parameters of advanced proprietary models are not accessible. Proxy-tuning provides a test-time o…