23 citations · 23 across the 5 of their papers we have counts for
3 papers · 1 filter
Mitigating Reward Over-optimization in Direct Alignment Algorithms with Importance Sampling
Phuc Minh Nguyen, Ngoc-Hieu Nguyen, Duy H. M. Nguyen +5
Direct Alignment Algorithms (DAAs) such as Direct Preference Optimization (DPO) have emerged as alternatives to the standard Reinforcement Learning from Human Feedback (RLHF) for a…
When Reasoning Meets Compression: Understanding the Effects of LLMs Compression on Large Reasoning Models
Nan Zhang, Eugene Kwek, Yusen Zhang +3
Compression methods, including quantization, distillation, and pruning, improve the computational efficiency of large reasoning models (LRMs). However, existing studies either fail…
Towards Efficient Communication and Secure Federated Recommendation System via Low-rank Training
Ngoc-Hieu Nguyen, Tuan-Anh Nguyen, Tuan Nguyen +3
Federated Recommendation (FedRec) systems have emerged as a solution to safeguard users' data in response to growing regulatory concerns. However, one of the major challenges in th…