3 papers
cs.CL2023
A Block Metropolis-Hastings Sampler for Controllable Energy-based Text Generation
Jarad Forristal, Niloofar Mireshghallah, Greg Durrett +1
Recent work has shown that energy-based language modeling is an effective framework for controllable text generation because it enables flexible integration of arbitrary discrimina…
cs.CL2022
Assessing Out-of-Domain Language Model Performance from Few Examples
Prasann Singhal, Jarad Forristal, Xi Ye +1
While pretrained language models have exhibited impressive generalization capabilities, they still behave unpredictably under certain domain shifts. In particular, a model may lear…
math.OC2022
A Novel Fast Exact Subproblem Solver for Stochastic Quasi-Newton Cubic Regularized Optimization
Jarad Forristal, Joshua Griffin, Wenwen Zhou +1
In this work we describe an Adaptive Regularization using Cubics (ARC) method for large-scale nonconvex unconstrained optimization using Limited-memory Quasi-Newton (LQN) matrices.…