9 papers
Scalable Causal Imitation Learning
Eylam Tagor, Mingxuan Li, Elias Bareinboim
Imitation learning enables learning a policy in an unknown environment with a latent reward signal using expert demonstrations, but it struggles when the imitator's and expert's ob…
Counterfactual Shapley Credit Assignment
Mingxuan Li, Kai-Zhan Lee, Kaizhan-Lee +1
The Credit Assignment Problem (CAP) is fundamental to developing efficient and explainable Reinforcement Learning (RL) agents. Existing frameworks, whether relying on temporal cont…
BCTuner: LLM-Guided Monte Carlo Tree Search for Efficient Blockchain Knob Tuning
Yaoyi Deng, Chongyang Tao, Mingxuan Li +4
Knob tuning plays a critical role in improving the performance of permissioned blockchains. However, efficient tuning remains challenging due to the architectural complexity of blo…
Confounding Robust Continuous Control via Automatic Reward Shaping
Mateo Juliani, Mingxuan Li, Elias Bareinboim
Reward shaping has been applied widely to accelerate Reinforcement Learning (RL) agents' training. However, a principled way of designing effective reward shaping functions, especi…
Causal Flow Q-Learning for Robust Offline Reinforcement Learning
Mingxuan Li, Junzhe Zhang, Elias Bareinboim
Expressive policies based on flow-matching have been successfully applied in reinforcement learning (RL) more recently due to their ability to model complex action distributions fr…
Confounding Robust Deep Reinforcement Learning: A Causal Approach
Mingxuan Li, Junzhe Zhang, Elias Bareinboim
A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, l…