5 papers
Parameter-Efficient Multi-Task Learning via Progressive Task-Specific Adaptation
Neeraj Gangwar, Anshuka Rangi, Rishabh Deshmukh +3
Parameter-efficient fine-tuning methods have emerged as a promising solution for adapting pre-trained models to various downstream tasks. While these methods perform well in single…
An efficient algorithm for entropic optimal transport under martingale-type constraints
Xun Tang, Michael Shavlovsky, Holakou Rahmanian +2
This work introduces novel computational methods for entropic optimal transport (OT) problems under martingale-type conditions. The considered problems include the discrete marting…
Online Dynamic Programming
Holakou Rahmanian, Manfred K. Warmuth, S. V. N. Vishwanathan
We propose a general method for combinatorial online learning problems whose offline optimization problem can be solved efficiently via a dynamic programming algorithm defined by a…
COS-DPO: Conditioned One-Shot Multi-Objective Fine-Tuning Framework
Yinuo Ren, Tesi Xiao, Michael Shavlovsky +2
In LLM alignment and many other ML applications, one often faces the Multi-Objective Fine-Tuning (MOFT) problem, i.e., fine-tuning an existing model with datasets labeled w.r.t. di…
Multi-Objective Optimization via Wasserstein-Fisher-Rao Gradient Flow
Yinuo Ren, Tesi Xiao, Tanmay Gangwani +4
Multi-objective optimization (MOO) aims to optimize multiple, possibly conflicting objectives with widespread applications. We introduce a novel interacting particle method for MOO…