10 papers · 1 filter
OR-Transformer: Scaling Real-Time Decision-Making to 1,000 Items
Shuze Daniel Liu, David Simchi-Levi, Claire Chen +2
Modern supply chain operations can require coordinating replenishment across thousands of heterogeneous items under correlated stochastic demand, heterogeneous lead times, and shar…
Robust Data-Collection Policy Learning for Low-Variance Online Policy Evaluation
Claire Chen, Shuze Daniel Liu, Licheng Luo +3
In reinforcement learning policy evaluation, classic on-policy methods often suffer from high variance when estimating policy performance. To mitigate this issue, behavior policy s…
Strategic Bargaining in Multi-Buyer Markets: Reinforcement Learning from Verifiable Rewards for LLM Negotiations
Shuze Daniel Liu, Claire Chen, Jiabao Sean Xiao +2
Negotiation is a fundamental strategic interaction in management science, characterized by agents attempting to reach agreements while protecting private information, such as reser…
Convergence of Two-Timescale Markovian Stochastic Approximations with Applications in Reinforcement Learning
Vagul Mahadevan, Claire Chen, Shuze Daniel Liu +1
This work studies the convergence of two-timescale stochastic approximations (SA), a class of iterative algorithms that update two sets of parameters in fast and slow timescales re…
Pessimism-Free Offline Learning in General-Sum Games via KL Regularization
Claire Chen, Yuheng Zhang
Offline multi-agent reinforcement learning in general-sum settings is challenged by the distribution shift between logged datasets and target equilibrium policies. While standard m…
Beyond Linear Attention: Softmax Transformers Implement In-Context Reinforcement Learning
Zixuan Xie, Xinyu Liu, Claire Chen +3
In-context reinforcement learning (ICRL) studies agents that, after pretraining, adapt to new tasks by conditioning on additional context without parameter updates. Existing theore…
Offline Two-Player Zero-Sum Markov Games with KL Regularization
Claire Chen, Yuheng Zhang, Xinyu Liu +3
We study the problem of learning Nash equilibria in offline two-player zero-sum Markov games. While existing approaches often rely on explicit pessimism to address distribution shi…
Predicting Plasticity in Deep Continual Learning: A Theoretical Perspective
Jiuqi Wang, Jayanth Srinivasa, Claire Chen +3
Deep continual learning requires models to adapt to new tasks without retraining from scratch. However, neural networks can lose their ability to adapt to new tasks after training…
Efficient Policy Evaluation with Safety Constraint for Reinforcement Learning
Claire Chen, Shuze Daniel Liu, Shangtong Zhang
In reinforcement learning, classic on-policy evaluation methods often suffer from high variance and require massive online data to attain the desired accuracy. Previous studies att…
Doubly Optimal Policy Evaluation for Reinforcement Learning
Shuze Daniel Liu, Claire Chen, Shangtong Zhang
Policy evaluation estimates the performance of a policy by (1) collecting data from the environment and (2) processing raw data into a meaningful estimate. Due to the sequential na…