2 papers
cs.CL2022
Assessing Out-of-Domain Language Model Performance from Few Examples
Prasann Singhal, Jarad Forristal, Xi Ye +1
While pretrained language models have exhibited impressive generalization capabilities, they still behave unpredictably under certain domain shifts. In particular, a model may lear…
math.OC2022
A Novel Fast Exact Subproblem Solver for Stochastic Quasi-Newton Cubic Regularized Optimization
Jarad Forristal, Joshua Griffin, Wenwen Zhou +1
In this work we describe an Adaptive Regularization using Cubics (ARC) method for large-scale nonconvex unconstrained optimization using Limited-memory Quasi-Newton (LQN) matrices.…