4 papers
Let the Target Select for Itself: Data Selection via Target-Aligned Paths
Huitao Yang, Hengzhi He, Guang Cheng
Targeted data selection aims to identify training samples from a large candidate pool that improve performance on a specific downstream task. Many recent methods estimate candidate…
In-Context Curiosity: Distilling Exploration for Decision-Pretrained Transformers on Bandit Tasks
Huitao Yang, Guanting Chen
As large language models (LLMs) continue to grow in capability, there is increasing interest in incorporating them into decision-making tasks. A common pipeline for this is Decisio…
Greedy Selection under Independent Increments: A Toy Model Analysis
Huitao Yang
We study an iterative selection problem over N i.i.d. discrete-time stochastic processes with independent increments. At each stage, a fixed number of processes are retained based…
Fast Best-of-N Decoding via Speculative Rejection
Hanshi Sun, Momin Haider, Ruiqi Zhang +6
The safe and effective deployment of Large Language Models (LLMs) involves a critical step called alignment, which ensures that the model's responses are in accordance with human p…