106 citations · 377 across the 79 of their papers we have counts for
17 papers · 1 filter
MUSO: Achieving Exact Machine Unlearning in Over-Parameterized Regimes
Ruikai Yang, Mingzhen He, Zhengbao He +2
Machine unlearning (MU) is to make a well-trained model behave as if it had never been trained on specific data. In today's over-parameterized models, dominated by neural networks,…
Unified Gradient-Based Machine Unlearning with Remain Geometry Enhancement
Zhehao Huang, Xinwen Cheng, JingHao Zheng +4
Machine unlearning (MU) has emerged to enhance the privacy and trustworthiness of deep neural networks. Approximate MU is a practical method for large-scale models. Our investigati…
Flat-LoRA: Low-Rank Adaptation over a Flat Loss Landscape
Tao Li, Zhengbao He, Yujun Li +3
Fine-tuning large-scale pre-trained models is prohibitively expensive in terms of computation and memory costs. Low-Rank Adaptation (LoRA), a popular Parameter-Efficient Fine-Tunin…
Beyond Perceptual Distance: Discrepancy Assessment on Deep Representation for Out-of-Distribution Detection with Diffusion Model
Kun Fang, Zuopeng Yang, Haibo Hu +3
Out-of-Distribution (OoD) detection aims to justify whether a given sample is from the training distribution of the classifier-under-protection, i.e., In-Distribution (InD), or fro…
Learning Scalable Model Soup on a Single GPU: An Efficient Subspace Training Strategy
Tao Li, Weisen Jiang, Fanghui Liu +2
Pre-training followed by fine-tuning is widely adopted among practitioners. The performance can be improved by "model soups"~\cite{wortsman2022model} via exploring various hyperpar…
Learning Analysis of Kernel Ridgeless Regression with Asymmetric Kernel Learning
Fan He, Mingzhen He, Lei Shi +2
Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate…
Pursuing Feature Separation based on Neural Collapse for Out-of-Distribution Detection
Yingwen Wu, Ruiji Yu, Xinwen Cheng +2
In the open world, detecting out-of-distribution (OOD) data, whose labels are disjoint with those of in-distribution (ID) samples, is important for reliable deep neural networks (D…
Towards Natural Machine Unlearning
Zhengbao He, Tao Li, Xinwen Cheng +2
Machine unlearning (MU) aims to eliminate information that has been learned from specific training data, namely forgetting data, from a pre-trained model. Currently, the mainstream…
Data Imputation by Pursuing Better Classification: A Supervised Kernel-Based Method
Ruikai Yang, Fan He, Mingzhen He +2
Data imputation, the process of filling in missing feature elements for incomplete data sets, plays a crucial role in data-driven learning. A fundamental belief is that data imputa…
Decentralized Kernel Ridge Regression Based on Data-Dependent Random Feature
Ruikai Yang, Fan He, Mingzhen He +2
Random feature (RF) has been widely used for node consistency in decentralized kernel ridge regression (KRR). Currently, the consistency is guaranteed by imposing constraints on co…
Inverse-Free Fast Natural Gradient Descent Method for Deep Learning
Xinwei Ou, Ce Zhu, Xiaolin Huang +1
Second-order optimization techniques have the potential to achieve faster convergence rates compared to first-order methods through the incorporation of second-order derivatives or…
Revisiting Random Weight Perturbation for Efficiently Improving Generalization
Tao Li, Qinghua Tao, Weihao Yan +5
Improving the generalization ability of modern deep neural networks (DNNs) is a fundamental challenge in machine learning. Two branches of methods have been proposed to seek flat m…
OrthCaps: An Orthogonal CapsNet with Sparse Attention Routing and Pruning
Xinyu Geng, Jiaming Wang, Jiawei Gong +4
Redundancy is a persistent challenge in Capsule Networks (CapsNet),leading to high computational costs and parameter counts. Although previous works have introduced pruning after t…
Friendly Sharpness-Aware Minimization
Tao Li, Pan Zhou, Zhengbao He +2
Sharpness-Aware Minimization (SAM) has been instrumental in improving deep neural network training by minimizing both training loss and loss sharpness. Despite the practical succes…
Remaining-data-free Machine Unlearning by Suppressing Sample Contribution
Xinwen Cheng, Zhehao Huang, Wenxin Zhou +4
Machine unlearning (MU) aims to remove the influence of specific training samples from a well-trained model, a task of growing importance due to the ``right to be forgotten.'' The…
Kernel PCA for Out-of-Distribution Detection
Kun Fang, Qinghua Tao, Kexin Lv +3
Out-of-Distribution (OoD) detection is vital for the reliability of Deep Neural Networks (DNNs). Existing works have shown the insufficiency of Principal Component Analysis (PCA) s…
Learn What You Need in Personalized Federated Learning
Kexin Lv, Rui Ye, Xiaolin Huang +2
Personalized federated learning aims to address data heterogeneity across local clients in federated learning. However, current methods blindly incorporate either full model parame…