3 papers
cs.LG2026
Intrinsic Interaction Geometry Controls the Low-Rank Complexity of Softmax Attention
Yuhe Sui, Jianing Zhang, Yingzhi Tang
How much matrix rank is required to preserve every bounded value output of normalized softmax attention? We study the unrestricted maximum-row-\(\ell_1\) approximation rank \(r_\va…
cs.LG2025
Communication-Efficient and Differentially Private Vertical Federated Learning with Zeroth-Order Optimization
Jianing Zhang, Evan Chen, Dong-Jun Han +2
Vertical Federated Learning (VFL) enables collaborative model training across feature-partitioned devices, yet its reliance on device-server information exchange introduces signifi…
cs.LG2025
Correcting Before Adapting: Gradient Correction for Federated Adaptive Optimization
Evan Chen, Shiqiang Wang, Jianing Zhang +4
Client-drift compensation methods mitigate the impact of data heterogeneity in federated learning (FL). While drift correction is well studied for stochastic gradient descent (SGD)…