3 citations · 6 across the 11 of their papers we have counts for
4 papers · 1 filter
FlashBoB: I/O-Efficient Exact Backward-over-Backward for Softmax Attention
Anthony Givans, Michael Crawshaw, Mingrui Liu
Transformer models built on the attention mechanism have become a central building block in modern deep learning, yet softmax attention remains a major bottleneck for long-context…
How Edge of Stability Hinders SCAFFOLD in Federated Optimization
Anant Khandelwal, Michael Crawshaw, Mingrui Liu
In federated learning, it is well known that heterogeneous data can (in theory) slow down optimization, and much effort has been directed at designing optimization algorithms that…
CURE-OOD: Benchmarking Out-of-Distribution Detection for Survival Prediction
Wenjie Zhao, Jia Li, Mingrui Liu +2
``How long can I live and remain free of cancer?'' is often the first question a patient asks after receiving a cancer diagnosis and treatment. Accurate survival prediction helps a…
Tight Bounds for Logistic Regression with Large Stepsize Gradient Descent in Low Dimension
Michael Crawshaw, Mingrui Liu
We consider the optimization problem of minimizing the logistic loss with gradient descent to train a linear model for binary classification with separable data. With a budget of $…