most citedHow Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning

24 citations · 70 across the 12 of their papers we have counts for

collaborators

12 papers

cs.CV2023★ 9 cited

DimCL: Dimensional Contrastive Learning For Improving Self-Supervised Learning

Thanh Nguyen, Trung Pham, Chaoning Zhang +3

Self-supervised learning (SSL) has gained remarkable success, for which contrastive learning (CL) plays a key role. However, the recent development of new non-CL frameworks has ach…

cs.CV2023★ 1 cited

Progressive Fourier Neural Representation for Sequential Video Compilation

Haeyong Kang, Jaehong Yoon, DaHyun Kim +2

Neural Implicit Representation (NIR) has recently gained significant attention due to its remarkable ability to encode complex and high-dimensional data into representation space a…

cs.LG2023

Forget-free Continual Learning with Soft-Winning SubNetworks

Haeyong Kang, Jaehong Yoon, Sultan Rizky Madjid +2

Inspired by Regularized Lottery Ticket Hypothesis (RLTH), which states that competitive smooth (non-binary) subnetworks exist within a dense network in continual learning tasks, we…

cs.LG2023★ 13 cited

Skew Class-balanced Re-weighting for Unbiased Scene Graph Generation

Haeyong Kang, Chang D. Yoo

An unbiased scene graph generation (SGG) algorithm referred to as Skew Class-balanced Re-weighting (SCR) is proposed for considering the unbiased predicate prediction caused by the…

cs.CV2022

Self-Supervised Visual Representation Learning via Residual Momentum

Trung X. Pham, Axi Niu, Zhang Kang +5

Self-supervised learning (SSL) approaches have shown promising capabilities in learning the representation from unlabeled data. Amongst them, momentum-based frameworks have attract…

cs.CV2022★ 1 cited

LAD: A Hybrid Deep Learning System for Benign Paroxysmal Positional Vertigo Disorders Diagnostic

Trung Xuan Pham, Jin Woong Choi, Rusty John Lloyd Mina +3

Herein, we introduce "Look and Diagnose" (LAD), a hybrid deep learning-based system that aims to support doctors in the medical field in diagnosing effectively the Benign Paroxysma…

cs.LG2022★ 12 cited

On the Soft-Subnetwork for Few-shot Class Incremental Learning

Haeyong Kang, Jaehong Yoon, Sultan Rizky Hikmawan Madjid +2

Inspired by Regularized Lottery Ticket Hypothesis (RLTH), which hypothesizes that there exist smooth (non-binary) subnetworks within a dense network that achieve the competitive pe…

cs.CV2022★ 5 cited

On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning

Trung Pham, Chaoning Zhang, Axi Niu +2

Exponential Moving Average (EMA or momentum) is widely used in modern self-supervised learning (SSL) approaches, such as MoCo, for enhancing performance. We demonstrate that such m…

cs.CV2022★ 2 cited

Decoupled Adversarial Contrastive Learning for Self-supervised Adversarial Robustness

Chaoning Zhang, Kang Zhang, Chenshuang Zhang +4

Adversarial training (AT) for robust representation learning and self-supervised learning (SSL) for unsupervised representation learning are two active research fields. Integrating…

cs.LG2022★ 1 cited

Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo

Chaoning Zhang, Kang Zhang, Trung X. Pham +4

Contrastive learning (CL) is widely known to require many negative samples, 65536 in MoCo for instance, for which the performance of a dictionary-free framework is often inferior b…

cs.LG2022★ 24 cited

How Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning

Chaoning Zhang, Kang Zhang, Chenshuang Zhang +3

To avoid collapse in self-supervised learning (SSL), a contrastive loss is widely used but often requires a large number of negative samples. Without negative samples yet achieving…

cs.LG2022★ 2 cited

Fast Adversarial Training with Noise Augmentation: A Unified Perspective on RandStart and GradAlign

Axi Niu, Kang Zhang, Chaoning Zhang +4

PGD-based and FGSM-based are two popular adversarial training (AT) approaches for obtaining adversarially robust models. Compared with PGD-based AT, FGSM-based one is significantly…