4 papers · 1 filter
MoPLEx: Estimating Plackett-Luce Mixture Models for Multi-Objective Alignment
Dongyue Li, Ziniu Zhang, Lu Wang +1
We study learning a mixture of Plackett-Luce models from multi-way ranking responses from annotators that may represent heterogeneous underlying preferences. This problem has m…
Theory-optimal Quantization Based on Flatness
Xiusheng Huang, Zhe Li, Xuanwu Yin +5
Post-training quantization has emerged as a widely adopted technique for compressing and accelerating the inference of Large Language Models (LLMs). The primary challenges in LLMs…
Linear-Time Demonstration Selection for In-Context Learning via Gradient Estimation
Ziniu Zhang, Zhenshuo Zhang, Dongyue Li +3
This paper introduces an algorithm to select demonstration examples for in-context learning of a query set. Given a set of examples, how can we quickly select out of to…
Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets
Dongyue Li, Ziniu Zhang, Lu Wang +1
This paper develops an ensemble method for fine-tuning a language model to multiple datasets. Existing methods, such as quantized LoRA (QLoRA), are efficient when adapting to a sin…