activity
20212024
most citedEfficient Sharpness-aware Minimization for Improved Training of Neural Networks

26 citations · 92 across the 14 of their papers we have counts for

collaborators

14 papers

cs.CV2024★ 1 cited

LightningDrag: Lightning Fast and Accurate Drag-based Image Editing Emerging from Videos

Yujun Shi, Jun Hao Liew, Hanshu Yan +2

Accuracy and speed are critical in image editing tasks. Pan et al. introduced a drag-based image editing framework that achieves pixel-level control using Generative Adversarial Ne…

cs.CV2023★ 1 cited

Towards Accurate Guided Diffusion Sampling through Symplectic Adjoint Method

Jiachun Pan, Hanshu Yan, Jun Hao Liew +2

Training-free guided sampling in diffusion models leverages off-the-shelf pre-trained networks, such as an aesthetic evaluation model, to guide the generation process. Current trai…

eess.SP2023

Deep Unrolling for Nonconvex Robust Principal Component Analysis

Elizabeth Z. C. Tan, Caroline Chaux, Emmanuel Soubies +1

We design algorithms for Robust Principal Component Analysis (RPCA) which consists in decomposing a matrix into the sum of a low rank matrix and a sparse matrix. We propose a deep…

cs.CV2023

AdjointDPM: Adjoint Sensitivity Method for Gradient Backpropagation of Diffusion Probabilistic Models

Jiachun Pan, Jun Hao Liew, Vincent Y. F. Tan +2

Existing customization methods require access to multiple reference examples to align pre-trained diffusion probabilistic models (DPMs) with user-provided concepts. This paper aims…

cs.CV2023★ 15 cited

DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing

Yujun Shi, Chuhui Xue, Jun Hao Liew +5

Accurate and controllable image editing is a challenging task that has attracted significant attention recently. Notably, DragGAN is an interactive point-based image editing framew…

cs.LG2022★ 3 cited

Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation

Jiawei Du, Yidi Jiang, Vincent Y. F. Tan +2

Model-based deep learning has achieved astounding successes due in part to the availability of large-scale real-world data. However, processing such massive amounts of data comes a…

cs.IT2022★ 2 cited

How Does Pseudo-Labeling Affect the Generalization Error of the Semi-Supervised Gibbs Algorithm?

Haiyun He, Gholamali Aminian, Yuheng Bu +2

We provide an exact characterization of the expected generalization error (gen-error) for semi-supervised learning (SSL) with pseudo-labeling via the Gibbs algorithm. The gen-error…

cs.LG2022★ 12 cited

Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning

Yujun Shi, Jian Liang, Wenqing Zhang +2

Federated learning aims to train models collaboratively across different clients without the sharing of data for privacy considerations. However, one major challenge for this learn…

cs.LG2022★ 15 cited

Sharpness-Aware Training for Free

Jiawei Du, Daquan Zhou, Jiashi Feng +2

Modern deep neural networks (DNNs) have achieved state-of-the-art performances but are typically over-parameterized. The over-parameterization may result in undesirably large gener…

eess.IV2022★ 1 cited

Towards Adversarially Robust Deep Image Denoising

Hanshu Yan, Jingfeng Zhang, Jiashi Feng +2

This work systematically investigates the adversarial robustness of deep image denoisers (DIDs), i.e, how well DIDs can recover the ground truth from noisy observations degraded by…

cs.CV2021★ 3 cited

Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning

Yujun Shi, Kuangqi Zhou, Jian Liang +5

Class Incremental Learning (CIL) aims at learning a multi-class classifier in a phase-by-phase manner, in which only data of a subset of the classes are provided at each phase. Pre…

cs.AI2021★ 26 cited

Efficient Sharpness-aware Minimization for Improved Training of Neural Networks

Jiawei Du, Hanshu Yan, Jiashi Feng +4

Overparametrized Deep Neural Networks (DNNs) often achieve astounding performances, but may potentially result in severe generalization error. Recently, the relation between the sh…

cs.LG2021★ 2 cited

Information-Theoretic Characterization of the Generalization Error for Iterative Semi-Supervised Learning

Haiyun He, Hanshu Yan, Vincent Y. F. Tan

Using information-theoretic principles, we consider the generalization error (gen-error) of iterative semi-supervised learning (SSL) algorithms that iteratively generate pseudo-lab…

cs.LG2021★ 11 cited

CIFS: Improving Adversarial Robustness of CNNs via Channel-wise Importance-based Feature Selection

Hanshu Yan, Jingfeng Zhang, Gang Niu +3

We investigate the adversarial robustness of CNNs from the perspective of channel-wise activations. By comparing \textit{non-robust} (normally trained) and \textit{robustified} (ad…