6 papers
The Hidden Power of Scaling Factor in LoRA Optimization
Zicheng Zhang, Haoran Li, Jiaxing Wang +10
In Low-Rank Adaptation (LoRA), the scaling factor is often treated as a mere complement to the learning rate, yet its role in optimization remains poorly understood. In this p…
On the Tension Between Optimality and Adversarial Robustness in Policy Optimization
Haoran Li, Jiayu Lv, Congying Han +5
Achieving optimality and adversarial robustness in deep reinforcement learning has long been regarded as conflicting goals. Nonetheless, recent theoretical insights presented in CA…
Mitigating Distribution Shift in Model-based Offline RL via Shifts-aware Reward Learning
Wang Luo, Haoran Li, Zicheng Zhang +4
Model-based offline reinforcement learning trains policies using pre-collected datasets and learned environment models, eliminating the need for direct real-world environment inter…
Dual Alignment Maximin Optimization for Offline Model-based RL
Chi Zhou, Wang Luo, Haoran Li +3
Offline reinforcement learning agents face significant deployment challenges due to the synthetic-to-real distribution mismatch. While most prior research has focused on improving…
Purity Law for Generalizable Neural TSP Solvers
Wenzhao Liu, Haoran Li, Congying Han +3
Achieving generalization in neural approaches across different scales and distributions remains a significant challenge for the Traveling Salesman Problem~(TSP). A key obstacle is…
Towards Optimal Adversarial Robust Reinforcement Learning with Infinity Measurement Error
Haoran Li, Zicheng Zhang, Wang Luo +4
Ensuring the robustness of deep reinforcement learning (DRL) agents against adversarial attacks is critical for their trustworthy deployment. Recent research highlights the challen…