Bilevel Optimization over Saddle Points of Zero-Sum Markov Games

Zihao Zheng, Irwin King, Songtao Lu

Reinforcement learning (RL) often has a hierarchical structure, where an upper-level (UL) learner selects model parameters and a lower-level (LL) decision-making process responds,…