15 papers
Exact Generalization Error Curves of Kernel Ridge Regression for Functional Moment Estimation
Yinan Ding, Yicheng Li
Kernel ridge regression is a standard method for functional data analysis, but its exact behavior is less understood. We study tensor-product kernel ridge regression for estimating…
A Van Trees Lower Bound for Fully Interactive Differentially Private Federated Learning
T. Tony Cai, Yicheng Li
Federated differentially private protocols can communicate over many adaptive rounds and reuse each client's local samples. Existing lower bound arguments for federated DP are ofte…
Generalization Error Curves for Analytic Spectral Algorithms under Power-law Decay
Yicheng Li, Weiye Gan, Zuoqiang Shi +1
The generalization error curve of certain kernel regression method aims at determining the exact order of generalization error with various source condition, noise level and choice…
AMO: Adaptive Muon Orthogonalization
Xinlin Zhuang, Panyi Ouyang, Yichen Li +7
Muon has recently emerged as a competitive alternative to AdamW for large-scale pre-training, with orthogonalization via Newton-Schulz (NS) iterations as its core operation. Existi…
Large Dimensional Kernel Ridge Regression: Extending to Product Kernels
Yang Zhou, Yicheng Li, Yuqian Cheng +1
Recent studies have reported and in large dimensional kernel ridge regression (KRR). However, these findings are…
Alignment-Sensitive Minimax Rates for Spectral Algorithms with Learned Kernels
Dongming Huang, Zhifan Li, Yicheng Li +1
We study spectral algorithms in the setting where kernels are learned from data. We introduce the effective span dimension (ESD), an alignment-sensitive complexity measure that dep…