24 citations · 60 across the 10 of their papers we have counts for
5 papers · 1 filter
From Gradient Flow on Population Loss to Learning with Stochastic Gradient Descent
Satyen Kale, Jason D. Lee, Chris De Sa +2
Stochastic Gradient Descent (SGD) has been the method of choice for learning large-scale non-convex models. While a general analysis of when SGD works has been elusive, there has b…
MCTensor: A High-Precision Deep Learning Library with Multi-Component Floating-Point
Tao Yu, Wentao Guo, Jianan Canal Li +2
In this paper, we introduce MCTensor, a library based on PyTorch for providing general-purpose and high-precision arithmetic for DL training. MCTensor is used in the same way as Py…
Low-Precision Stochastic Gradient Langevin Dynamics
Ruqi Zhang, Andrew Gordon Wilson, Christopher De Sa
While low-precision optimization has been widely used to accelerate deep learning, low-precision sampling remains largely unexplored. As a consequence, sampling is simply infeasibl…
Non-Determinism and the Lawlessness of Machine Learning Code
A. Feder Cooper, Jonathan Frankle, Christopher De Sa
Legal literature on machine learning (ML) tends to focus on harms, and thus tends to reason about individual model outcomes and summary error rates. This focus has masked important…
Random Laplacian Features for Learning with Hyperbolic Space
Tao Yu, Christopher De Sa
Due to its geometric properties, hyperbolic space can support high-fidelity embeddings of tree- and graph-structured data, upon which various hyperbolic networks have been develope…