IPPO Learns the Game, Not the Team: A Study on Generalization in Heterogeneous Agent Teams

Ryan LeRoy, Jack Kolb

Multi-Agent Reinforcement Learning (MARL) is commonly deployed in settings where agents are trained via self-play with homogeneous teammates, often using parameter sharing and a si…