7 papers
A Cramér-von Mises Approach to Incentivizing Truthful Data Sharing
Alex Clinton, Thomas Zeng, Yiding Chen +2
Modern data marketplaces and data sharing consortia increasingly rely on incentive mechanisms to encourage agents to contribute data. However, schemes that reward agents based on t…
Avoiding scaling in RLHF through Preference-based Exploration
Mingyu Chen, Yiding Chen, Wen Sun +1
Reinforcement Learning from Human Feedback (RLHF) has emerged as a pivotal technique for large language model (LLM) alignment. This paper studies the setting of online RLHF and foc…
Collaborative Mean Estimation Among Heterogeneous Strategic Agents: Individual Rationality, Fairness, and Truthful Contribution
Alex Clinton, Yiding Chen, Xiaojin Zhu +1
We study a collaborative learning problem where agents aim to estimate a vector by sampling from associated univariate normal distributi…
Scaling Offline RL via Efficient and Expressive Shortcut Models
Nicolas Espinosa-Dice, Yiyi Zhang, Yiding Chen +5
Diffusion and flow models have emerged as powerful generative approaches capable of modeling diverse and multimodal behavior. However, applying these models to offline reinforcemen…
Efficient Controllable Diffusion via Optimal Classifier Guidance
Owen Oertell, Shikun Sun, Yiding Chen +3
The controllable generation of diffusion models aims to steer the model to generate samples that optimize some given objective functions. It is desirable for a variety of applicati…
Convergence Of Consistency Model With Multistep Sampling Under General Data Assumptions
Yiding Chen, Yiyi Zhang, Owen Oertell +1
Diffusion models accomplish remarkable success in data generation tasks across various domains. However, the iterative sampling process is computationally expensive. Consistency mo…