10 papers
Out-Of-The-Loop Multi-Fidelity Bayesian Optimization
Gustavo Sutter, Hao Wang, Luis Ricardez-Sandoval +2
Black-box optimization is a ubiquitous problem in science and engineering, often dealing with expensive objective functions with cheaper lower-fidelity proxies available. Multi-fid…
Chrysalis: A Unified System for Comparing Active Teaching and Passive Learning with AI Agents in Education
Prashanth Arun, Vinita Vader, Erya Xu +6
AI-assisted learning has seen a remarkable uptick over the last few years, mainly due to the rise in popularity of Large Language Models (LLMs). Their ability to hold long-form, na…
Time Is Effort: Estimating Human Post-Editing Time for Grammar Error Correction Tool Evaluation
Ankit Vadehra, Bill Johnson, Gene Saunders +1
Text editing can involve several iterations of revision. Incorporating an efficient Grammar Error Correction (GEC) tool in the initial correction round can significantly impact fur…
A Critical Look At Tokenwise Reward-Guided Text Generation
Ahmad Rashid, Ruotian Wu, Julia Grosse +2
Large language models (LLMs) can be improved by aligning with human preferences through fine-tuning -- the so-called reinforcement learning from human feedback (RLHF). However, the…
Uncertainty-Guided Likelihood Tree Search
Julia Grosse, Ruotian Wu, Ahmad Rashid +4
Tree search is a fundamental tool for planning, as many sequential decision-making problems can be framed as searching over tree-structured spaces. We propose an uncertainty-guided…
Towards Cost-Effective Reward Guided Text Generation
Ahmad Rashid, Ruotian Wu, Rongqi Fan +3
Reward-guided text generation (RGTG) has emerged as a viable alternative to offline reinforcement learning from human feedback (RLHF). RGTG methods can align baseline language mode…