3 papers
stat.ME2026
Sample continuation in Bayesian hierarchical model via variational inference
Yucong Liu, Zilai Si, Alexander Strang
Posterior distributions arising in ill-posed Bayesian inverse problems are often both analytically intractable and highly sensitive to parameters of the chosen prior family. We aim…
cs.LG2025
A Bootstrap Perspective on Stochastic Gradient Descent
Hongjian Lan, Yucong Liu, Florian Schäfer
Machine learning models trained with \emph{stochastic} gradient descent (SGD) can generalize better than those trained with deterministic gradient descent (GD). In this work, we st…
cs.AI2024
Attention is a smoothed cubic spline
Zehua Lai, Lek-Heng Lim, Yucong Liu
We highlight a perhaps important but hitherto unobserved insight: The attention module in a transformer is a smoothed cubic spline. Viewed in this manner, this mysterious but criti…