53 citations · 58 across the 14 of their papers we have counts for
5 papers · 1 filter
Vision: "What Don't I Know About User's Preferences?" How Uncertainty Estimation Improves Proactive Assistant Alignment
Zhiyu An, Ziyi Xuan, Yu Yang +1
Proactive Smart Assistants (PSAs) increasingly use general knowledge, learned patterns from group-level data, patterns from individual user's data, and recent sensor observations t…
Open Problems in Differentiable Social Choice: Learning Mechanisms, Decisions, and Alignment
Zhiyu An, Wan Du
Social choice has become a foundational component of modern machine learning systems. From auctions and resource allocation to the alignment of large generative models, machine lea…
DIML: Differentiable Inverse Mechanism Learning from Behaviors of Multi-Agent Learning Trajectories
Zhiyu An, Wan Du
We study inverse mechanism learning: recovering an unknown incentive-generating mechanism from observed strategic interaction traces of self-interested learning agents. Unlike inve…
MoralReason: Generalizable Moral Decision Alignment For LLM Agents Using Reasoning-Level Reinforcement Learning
Zhiyu An, Wan Du
Large language models are increasingly influencing human moral decisions, yet current approaches focus primarily on evaluating rather than actively steering their moral decisions.…
Reward Bound for Behavioral Guarantee of Model-based Planning Agents
Zhiyu An, Xianzhong Ding, Wan Du
Recent years have seen an emerging interest in the trustworthiness of machine learning-based agents in the wild, especially in robotics, to provide safety assurance for the industr…