activity
20182026
most citedRepresentational Strengths and Limitations of Transformers

13 citations · 35 across the 15 of their papers we have counts for

collaborators
Showing 2022Show all

5 papers · 1 filter

physics.ao-ph2022★ 2 cited

Improving the predictions of ML-corrected climate models with novelty detection

Clayton Sanford, Anna Kwa, Oliver Watt-Meyer +4

While previous works have shown that machine learning (ML) can improve the prediction accuracy of coarse-grid climate models, these ML-augmented methods are more vulnerable to irre…

cs.LG2022★ 11 cited

Learning Single-Index Models with Shallow Neural Networks

Alberto Bietti, Joan Bruna, Clayton Sanford +1

Single-index models are a class of functions given by an unknown univariate ``link'' function applied to an unknown one-dimensional projection of the input. These models are partic…

cs.LG2022

On Scrambling Phenomena for Randomly Initialized Recurrent Networks

Vaggos Chatziafratis, Ioannis Panageas, Clayton Sanford +1

Recurrent Neural Networks (RNNs) frequently exhibit complicated dynamics, and their sensitivity to the initialization process often renders them notoriously hard to train. Recent w…

cs.LG2022

Intrinsic dimensionality and generalization properties of the -norm inductive bias

Navid Ardeshir, Daniel Hsu, Clayton Sanford

We study the structural and statistical properties of -norm minimizing interpolants of datasets labeled by specific target functions. The -norm is the bas…

cs.LG2022

Near-Optimal Statistical Query Lower Bounds for Agnostically Learning Intersections of Halfspaces with Gaussian Marginals

Daniel Hsu, Clayton Sanford, Rocco Servedio +1

We consider the well-studied problem of learning intersections of halfspaces under the Gaussian distribution in the challenging \emph{agnostic learning} model. Recent work of Diako…