145 citations · 155 across the 18 of their papers we have counts for
8 papers · 1 filter
Conflux-PSRO: Effectively Leveraging Collective Advantages in Policy Space Response Oracles
Yucong Huang, Jiesong Lian, Mingzhi Wang +2
Policy Space Response Oracle (PSRO) with policy population construction has been demonstrated as an effective method for approximating Nash Equilibrium (NE) in zero-sum games. Exis…
Sample-Efficient Regret-Minimizing Double Oracle in Extensive-Form Games
Xiaohang Tang, Chiyuan Wang, Chengdong Ma +3
Extensive-Form Game (EFG) represents a fundamental model for analyzing sequential interactions among multiple agents and the primary challenge to solve it lies in mitigating sample…
Magnetic Preference Optimization: Achieving Last-iterate Convergence for Language Model Alignment
Mingzhi Wang, Chengdong Ma, Qizhi Chen +7
Self-play methods have demonstrated remarkable success in enhancing model capabilities across various domains. In the context of Reinforcement Learning from Human Feedback (RLHF),…
Towards Efficient Collaboration via Graph Modeling in Reinforcement Learning
Wenzhe Fan, Zishun Yu, Chengdong Ma +3
In multi-agent reinforcement learning, a commonly considered paradigm is centralized training with decentralized execution. However, in this framework, decentralized execution rest…
A Survey on Self-play Methods in Reinforcement Learning
Ruize Zhang, Zelai Xu, Chengdong Ma +8
Self-play, a learning paradigm where agents iteratively refine their policies by interacting with historical or concurrent versions of themselves or other evolving agents, has show…
Fusion-PSRO: Nash Policy Fusion for Policy Space Response Oracles
Jiesong Lian, Yucong Huang, Chengdong Ma +4
For solving zero-sum games involving non-transitivity, a useful approach is to maintain a policy population to approximate the Nash Equilibrium (NE). Previous studies have shown th…
Roadmap on Incentive Compatibility for AI Alignment and Governance in Sociotechnical Systems
Zhaowei Zhang, Fengshuo Bai, Mingzhi Wang +3
The burgeoning integration of artificial intelligence (AI) into human society brings forth significant implications for societal governance and safety. While considerable strides h…
Panacea: Pareto Alignment via Preference Adaptation for LLMs
Yifan Zhong, Chengdong Ma, Xiaoyuan Zhang +5
Current methods for large language model alignment typically use scalar human preference labels. However, this convention tends to oversimplify the multi-dimensional and heterogene…