77 citations · 584 across the 84 of their papers we have counts for
87 papers
ExTra: Exploratory Trajectory Optimization for Language Model Reinforcement Learning
Wenyang Hu, Junxiang Jia, Zhen Shu +3
Reinforcement Learning with Verifiable Rewards (RLVR) for language-model reasoning can fail at both extremes of task difficulty: easy prompts often produce all-correct, low-diversi…
MeMo: Memory as a Model
Ryan Wei Heng Quek, Sanghyuk Lee, Alfred Wei Lun Leong +6
Large language models (LLMs) achieve strong performance across a wide range of tasks, but remain frozen after pretraining until subsequent updates. Many real-world applications req…
BoLT: A Benchmark to Democratize Black-box Optimization Research for Expensive LLM Tasks
Ruth Wan Theng Chew, Zhiliang Chen, Apivich Hemachandra +1
Optimization of LLM training and inference configurations, such as hyperparameters, data mixtures, and prompts, is critical to performance, but it is often approached heuristically…
Is Data Shapley Not Better than Random in Data Selection? Ask NASH
Xiao Tian, Jue Fan, Rachael Hwee Ling Sim +3
Data selection studies the problem of identifying high-quality subsets of training data. While some existing works have considered selecting the subset of data with top- Data Sh…
INO-SGD: Addressing Utility Imbalance under Individualized Differential Privacy
Xiao Tian, Jue Fan, Rachael Hwee Ling Sim +1
Differential privacy (DP) is widely employed in machine learning to protect confidential or sensitive training data from being revealed. As data owners gain greater control over th…
De-attribute to Forget for LLM Unlearning
Xinyang Lu, Jiabao Pan, Rachael Hwee Ling Sim +3
The rapid development of large language models (LLMs) has raised concerns on the use of inappropriate data for training, which has led to a growing interest in LLM unlearning. Many…