5 papers
Who Speaks What from Afar: Eavesdropping In-Person Conversations via mmWave Sensing
Shaoying Wang, Hansong Zhou, Yukun Yuan +1
Multi-participant meetings occur across various domains, such as business negotiations and medical consultations, during which sensitive information like trade secrets, business st…
MEO: Mining Reliable Expert Signals for Offline Reinforcement Learning in Wireless Networks
Lipeng Zu, Hansong Zhou, Yu Qian +4
The operation of next-generation wireless networks increasingly hinges on Deep Reinforcement Learning (DRL) to optimize critical network decisions. Offline RL trains agents using a…
Behavior-Adaptive Q-Learning: A Unifying Framework for Offline-to-Online RL
Lipeng Zu, Hansong Zhou, Xiaonan Zhang
Offline reinforcement learning (RL) enables training from fixed data without online interaction, but policies learned offline often struggle when deployed in dynamic environments d…
Enhancing Q-Value Updates in Deep Q-Learning via Successor-State Prediction
Lipeng Zu, Hansong Zhou, Xiaonan Zhang
Deep Q-Networks (DQNs) estimate future returns by learning from transitions sampled from a replay buffer. However, the target updates in DQN often rely on next states generated by…
FedAR: Addressing Client Unavailability in Federated Learning with Local Update Approximation and Rectification
Chutian Jiang, Hansong Zhou, Xiaonan Zhang +1
Federated learning (FL) enables clients to collaboratively train machine learning models under the coordination of a server in a privacy-preserving manner. One of the main challeng…