285 citations · 298 across the 18 of their papers we have counts for
6 papers · 1 filter
When Data-Free Knowledge Distillation Meets Non-Transferable Teacher: Escaping Out-of-Distribution Trap is All You Need
Ziming Hong, Runnan Chen, Zengmao Wang +3
Data-free knowledge distillation (DFKD) transfers knowledge from a teacher to a student without access the real in-distribution (ID) data. Its common solution is to use a generator…
Intra-Trajectory Consistency for Reward Modeling
Chaoyang Zhou, Shunyu Liu, Zengmao Wang +4
Reward models are critical for improving large language models (LLMs), particularly in reinforcement learning from human feedback (RLHF) or inference-time verification. Current rew…
What If the Input is Expanded in OOD Detection?
Boxuan Zhang, Jianing Zhu, Zengmao Wang +3
Out-of-distribution (OOD) detection aims to identify OOD inputs from unknown classes, which is important for the reliable deployment of machine learning models in the open world. V…
Robust and Discriminative Labeling for Multi-label Active Learning Based on Maximum Correntropy Criterion
Bo Du, Zengmao Wang, Lefei Zhang +2
Multi-label learning draws great interests in many real world applications. It is a highly costly task to assign many labels by the oracle for one instance. Meanwhile, it is also h…
Exploring Representativeness and Informativeness for Active Learning
Bo Du, Zengmao Wang, Lefei Zhang +4
How can we find a general way to choose the most suitable samples for training a classifier? Even with very limited prior information? Active learning, which can be regarded as an…
Multi-class Active Learning: A Hybrid Informative and Representative Criterion Inspired Approach
Xi Fang, Zengmao Wang, Xinyao Tang +1
Labeling each instance in a large dataset is extremely labor- and time- consuming . One way to alleviate this problem is active learning, which aims to which discover the most valu…