4 papers · 1 filter
Conditional Sequence Modeling for Safe Reinforcement Learning
Wensong Bai, Chao Zhang, Qihang Xu +3
Offline safe reinforcement learning (RL) aims to learn policies from a fixed dataset while maximizing performance under cumulative cost constraints. In practice, deployment require…
FG-OrIU: Towards Better Forgetting via Feature-Gradient Orthogonality for Incremental Unlearning
Qian Feng, JiaHang Tu, Mintong Kang +3
Incremental unlearning (IU) is critical for pre-trained models to comply with sequential data deletion requests, yet existing methods primarily suppress parameters or confuse knowl…
Efficiently Access Diffusion Fisher: Within the Outer Product Span Space
Fangyikang Wang, Hubery Yin, Shaobin Zhuang +7
Recent Diffusion models (DMs) advancements have explored incorporating the second-order diffusion Fisher information (DF), defined as the negative Hessian of log density, into vari…
Neural Sinkhorn Gradient Flow
Huminhao Zhu, Fangyikang Wang, Chao Zhang +2
Wasserstein Gradient Flows (WGF) with respect to specific functionals have been widely used in the machine learning literature. Recently, neural networks have been adopted to appro…