11 papers
Pitfalls and Remedies for Multi-Task Bayesian Optimization
Carl Hvarfner, Sam Daulton, Max Balandat +1
Bayesian optimization routinely warm-starts a target experiment with data from related source tasks, and the multi-task Gaussian process is the textbook surrogate for the job. We r…
Embedding by Elicitation: Dynamic Representations for Bayesian Optimization of System Prompts
Zhiyuan Jerry Lin, Benjamin Letham, Samuel Dooley +2
System prompts are a central control mechanism in modern AI systems, shaping behavior across conversations, tasks, and user populations. Yet they are difficult to tune when feedbac…
LILO: Bayesian Optimization with Natural Language Feedback
Katarzyna Kobalczyk, Zhiyuan Jerry Lin, Benjamin Letham +3
Many real-world optimization problems are guided by complex, subjective preferences that are difficult to express as explicit closed-form objectives. In response, we introduce Lang…
BONSAI: Bayesian Optimization with Natural Simplicity and Interpretability
Samuel Daulton, David Eriksson, Maximilian Balandat +1
Bayesian optimization (BO) is a popular technique for sample-efficient optimization of black-box functions. In many applications, the parameters being tuned come with a carefully e…
MobileLLM-Flash: Latency-Guided On-Device LLM Design for Industry Scale Deployment
Hanxian Huang, Igor Fedorov, Andrey Gromov +14
Real-time AI experiences call for on-device large language models (OD-LLMs) optimized for efficient deployment on resource-constrained hardware. The most useful OD-LLMs produce nea…
Empirical Gaussian Processes
Jihao Andreas Lin, Sebastian Ament, Louis C. Tiao +3
Gaussian processes (GPs) are powerful and widely used probabilistic regression models, but their effectiveness in practice is often limited by the choice of kernel function. This k…