activity
20222024
most citedTraining Debiased Subnetworks with Contrastive Weight Pruning

2 citations · 3 across the 7 of their papers we have counts for

collaborators

7 papers

cs.CV2024

Derivative-Free Diffusion Manifold-Constrained Gradient for Unified XAI

Won Jun Kim, Hyungjin Chung, Jaemin Kim +3

Gradient-based methods are a prototypical family of explainability techniques, especially for image-based models. Nonetheless, they have several shortcomings in that they (1) requi…

cs.LG2024

Defining Neural Network Architecture through Polytope Structures of Dataset

Sangmin Lee, Abbas Mammadov, Jong Chul Ye

Current theoretical and empirical research in neural networks suggests that complex datasets require large network architectures for thorough classification, yet the precise nature…

cs.LG2023

Data Topology-Dependent Upper Bounds of Neural Network Widths

Sangmin Lee, Jong Chul Ye

This paper investigates the relationship between the universal approximation property of deep neural networks and topological characteristics of datasets. Our primary contribution…

cs.LG2022

Magnitude and Angle Dynamics in Training Single ReLU Neurons

Sangmin Lee, Byeongsu Sim, Jong Chul Ye

To understand learning the dynamics of deep ReLU networks, we investigate the dynamic system of gradient flow by decomposing it to magnitude and angle $ϕ(t):= π- θ(t)…

cs.LG2022★ 1 cited

Self-supervised debiasing using low rank regularization

Geon Yeong Park, Chanyong Jung, Sangmin Lee +2

Spurious correlations can cause strong biases in deep neural networks, impairing generalization ability. While most existing debiasing methods require full supervision on either sp…

cs.LG2022★ 2 cited

Training Debiased Subnetworks with Contrastive Weight Pruning

Geon Yeong Park, Sangmin Lee, Sang Wan Lee +1

Neural networks are often biased to spuriously correlated features that provide misleading statistical evidence that does not generalize. This raises an interesting question: ``Doe…

cs.LG2022

Support Vectors and Gradient Dynamics of Single-Neuron ReLU Networks

Sangmin Lee, Byeongsu Sim, Jong Chul Ye

Understanding implicit bias of gradient descent for generalization capability of ReLU networks has been an important research topic in machine learning research. Unfortunately, eve…