4 citations · 14 across the 6 of their papers we have counts for
6 papers
Frontier Language Models are not Robust to Adversarial Arithmetic, or "What do I need to say so you agree 2+2=5?
C. Daniel Freeman, Laura Culp, Aaron Parisi +27
We introduce and study the problem of adversarial arithmetic, which provides a simple yet challenging testbed for language model alignment. This problem is comprised of arithmetic…
Small-scale proxies for large-scale Transformer training instabilities
Mitchell Wortsman, Peter J. Liu, Lechao Xiao +13
Teams that have trained large Transformer-based models have reported training instabilities at large scale that did not appear when training with the same hyperparameters at smalle…
Synergy and Symmetry in Deep Learning: Interactions between the Data, Model, and Inference Algorithm
Lechao Xiao, Jeffrey Pennington
Although learning in high dimensions is commonly believed to suffer from the curse of dimensionality, modern machine learning methods often exhibit an astonishing power to tackle a…
Eigenspace Restructuring: a Principle of Space and Frequency in Neural Networks
Lechao Xiao
Understanding the fundamental principles behind the massive success of neural networks is one of the most important open questions in deep learning. However, due to the highly comp…
Higher decay inequalities for multilinear oscillatory integrals
Maxim Gilula, Philip T. Gressman, Lechao Xiao
In this paper we establish sharp estimates (up to logarithmic losses) for the multilinear oscillatory integral operator studied by Phong, Stein, and Sturm and Carbery and Wright on…
Bilinear Hilbert transforms associated to plane curves
Jingwei Guo, Lechao Xiao
We prove that the bilinear Hilbert transforms and maximal functions along certain general plane curves are bounded from to …