From the 1 of 7 linked papers with an AI index.
7 papers
Optimal Learning Under Tsybakov Noise
Steve Hanneke, Hongao Wang, Mingyue Xu
Probably Approximately Correct (PAC) learning [Val84] is a fundamental learning model that has been extensively investigated. In this model, $\mathcal{H} \subseteq \{0,1\}^{\mathca…
Attention-based representations for multi-task computation
Daniel Hsu, Mingyue Xu
Multi-head attention layers produce vector representations that support multiple downstream tasks. We establish bounds on the number of heads required in two simple and concrete mu…
To Grok Grokking: Provable Grokking in Ridge Regression
Mingyue Xu, Gal Vardi, Itay Safran
The paper provides a theoretical analysis of grokting—delayed generalization after overfitting—in ridge regression, showing how gradient descent with weight decay leads to three ph…
When More Data Doesn't Help: Limits of Adaptation in Multitask Learning
Steve Hanneke, Mingyue Xu
Multitask learning and related frameworks have achieved tremendous success in modern applications. In multitask learning problem, we are given a set of heterogeneous datasets colle…
Rethinking Gradient-based Adversarial Attacks on Point Cloud Classification
Jun Chen, Xinke Li, Mingyue Xu +2
Gradient-based adversarial attacks are widely used to evaluate the robustness of 3D point cloud classifiers, yet they often rely on uniform update rules that neglect point-wise het…
Universal rates of ERM for agnostic learning
Steve Hanneke, Mingyue Xu
The universal learning framework has been developed to obtain guarantees on the learning rates that hold for any fixed distribution, which can be much faster than the ones uniforml…