6 papers
Beyond Token-Local Imitation: Reward-Compatible Temporal Credit Assignment for On-Policy Distillation
Shiqi Liu, Zeyu He, Letian Tao +9
On-policy distillation (OPD) has emerged as an effective approach for large language model post-training, yet existing objectives face a trade-off between objective fidelity and op…
Factor-Aware Mixture-of-Experts with Pretrained Encoder for Combinatorial Generalization
Feihong Zhang, Guojian Zhan, Zeyu He +8
The integration of pretrained encoders with diffusion policies has become a dominant paradigm for visual robotic manipulation. However, it still struggles to generalize across comp…
STAPO: Stabilizing Reinforcement Learning for LLMs by Silencing Rare Spurious Tokens
Shiqi Liu, Zeyu He, Guojian Zhan +10
Reinforcement Learning (RL) has significantly improved large language model reasoning, but existing RL fine-tuning methods rely heavily on heuristic techniques such as entropy regu…
One Filters All: A Generalist Filter for State Estimation
Shiqi Liu, Wenhan Cao, Chang Liu +3
Estimating hidden states in dynamical systems, also known as optimal filtering, is a long-standing problem in various fields of science and engineering. In this paper, we introduce…
Design and Experimental Test of Datatic Approximate Optimal Filter in Nonlinear Dynamic Systems
Weixian He, Zeyu He, Wenhan Cao +5
Filtering is crucial in engineering fields, providing vital state estimation for control systems. However, the nonlinear nature of complex systems and the presence of non-Gaussian…
Convolutional Bayesian Filtering
Wenhan Cao, Shiqi Liu, Chang Liu +3
Bayesian filtering serves as the mainstream framework of state estimation in dynamic systems. Its standard version utilizes total probability rule and Bayes' law alternatively, whe…