4 papers
Constrained Language Model Policy Optimization via Risk-aware Stepwise Alignment
Lijun Zhang, Lin Li, Wei Wei +5
When fine-tuning pre-trained Language Models (LMs) to exhibit desired behaviors, maintaining control over risk is critical for ensuring both safety and trustworthiness. Most existi…
Goal-Guided Efficient Exploration via Large Language Model in Reinforcement Learning
Yajie Qi, Wei Wei, Lin Li +4
Real-world decision-making tasks typically occur in complex and open environments, posing significant challenges to reinforcement learning (RL) agents' exploration efficiency and l…
Scaling DRL for Decision Making: A Survey on Data, Network, and Training Budget Strategies
Yi Ma, Hongyao Tang, Chenjun Xiao +4
In recent years, the expansion of neural network models and training data has driven remarkable progress in deep learning, particularly in computer vision and natural language proc…
Risk-aware Direct Preference Optimization under Nested Risk Measure
Lijun Zhang, Lin Li, Yajie Qi +4
When fine-tuning pre-trained Large Language Models (LLMs) to align with human values and intentions, maximizing the estimated reward can lead to superior performance, but it also i…