activity
20212026
most citedLearning Privacy-Preserving Student Networks via Discriminative-Generative Distillation

26 citations · 41 across the 14 of their papers we have counts for

collaborators

14 papers

cs.LG2026

Privacy-Preserving Model Transcription with Differentially Private Synthetic Distillation

Bochao Liu, Shiming Ge, Pengju Wang +2

While many deep learning models trained on private datasets have been deployed in various practical tasks, they may pose a privacy leakage risk as attackers could recover informati…

cs.LG2024★ 1 cited

Towards Personalized Federated Learning via Comprehensive Knowledge Distillation

Pengju Wang, Bochao Liu, Weijia Guo +2

Federated learning is a distributed machine learning paradigm designed to protect data privacy. However, data heterogeneity across various clients results in catastrophic forgettin…

cs.LG2024

Personalized Federated Learning via Backbone Self-Distillation

Pengju Wang, Bochao Liu, Dan Zeng +2

In practical scenarios, federated learning frequently necessitates training personalized models for each client using heterogeneous data. This paper proposes a backbone self-distil…

cs.LG2024

Federated Learning with Label-Masking Distillation

Jianghu Lu, Shikun Li, Kexin Bao +3

Federated learning provides a privacy-preserving manner to collaboratively train models on data distributed over multiple local clients via the coordination of a global server. In…

cs.LG2024

Privacy-Preserving Student Learning with Differentially Private Data-Free Distillation

Bochao Liu, Jianghu Lu, Pengju Wang +4

Deep learning models can achieve high inference accuracy by extracting rich knowledge from massive well-annotated data, but may pose the risk of data privacy leakage in practical d…

cs.LG2024★ 26 cited

Learning Privacy-Preserving Student Networks via Discriminative-Generative Distillation

Shiming Ge, Bochao Liu, Pengju Wang +2

While deep models have proved successful in learning rich knowledge from massive well-annotated data, they may pose a privacy leakage risk in practical deployment. It is necessary…

cs.LG2024

Learning Differentially Private Diffusion Models via Stochastic Adversarial Distillation

Bochao Liu, Pengju Wang, Shiming Ge

While the success of deep learning relies on large amounts of training datasets, data is often limited in privacy-sensitive domains. To address this challenge, generative model lea…

cs.CV2023★ 1 cited

M3D: Dataset Condensation by Minimizing Maximum Mean Discrepancy

Hansong Zhang, Shikun Li, Pengju Wang +2

Training state-of-the-art (SOTA) deep models often requires extensive data, resulting in substantial training and storage costs. To address these challenges, dataset condensation h…

cs.CV2023★ 1 cited

Private Gradient Estimation is Useful for Generative Modeling

Bochao Liu, Pengju Wang, Weijia Guo +4

While generative models have proved successful in many domains, they may pose a privacy leakage risk in practical deployment. To address this issue, differentially private generati…

cs.CR2023

Model Conversion via Differentially Private Data-Free Distillation

Bochao Liu, Pengju Wang, Shikun Li +2

While massive valuable deep models trained on large-scale data have been released to facilitate the artificial intelligence community, they may encounter attacks in deployment whic…

cs.CV2022

Randomized Quantization: A Generic Augmentation for Data Agnostic Self-supervised Learning

Huimin Wu, Chenyang Lei, Xiao Sun +5

Self-supervised representation learning follows a paradigm of withholding some part of the data and tasking the network to predict it from the remaining part. Among many techniques…

cs.CV2022★ 4 cited

Deepfake Video Detection with Spatiotemporal Dropout Transformer

Daichi Zhang, Fanzhao Lin, Yingying Hua +3

While the abuse of deepfake technology has caused serious concerns recently, how to detect deepfake videos is still a challenge due to the high photo-realistic synthesis of each fr…

cs.CV2022★ 8 cited

Sparsity Winning Twice: Better Robust Generalization from More Efficient Training

Tianlong Chen, Zhenyu Zhang, Pengjun Wang +4

Recent studies demonstrate that deep networks, even robustified by the state-of-the-art adversarial training (AT), still suffer from large robust generalization gaps, in addition t…

cs.CV2021

Interpretable Face Manipulation Detection via Feature Whitening

Yingying Hua, Daichi Zhang, Pengju Wang +1

Why should we trust the detections of deep neural networks for manipulated faces? Understanding the reasons is important for users in improving the fairness, reliability, privacy a…