7 citations · 10 across the 8 of their papers we have counts for
5 papers · 1 filter
Elucidating Subspace Perturbation in Zeroth-Order Optimization: Theory and Practice at Scale
Sihwan Park, Jihun Yun, SungYub Kim +2
Zeroth-order (ZO) optimization has emerged as a promising alternative to gradient-based backpropagation methods, particularly for black-box optimization and large language model (L…
TEDDY: Trimming Edges with Degree-based Discrimination strategY
Hyunjin Seo, Jihun Yun, Eunho Yang
Since the pioneering work on the lottery ticket hypothesis for graph neural networks (GNNs) was proposed in Chen et al. (2021), the study on finding graph lottery tickets (GLT) has…
Cluster-Promoting Quantization with Bit-Drop for Minimizing Network Quantization Loss
Jung Hyun Lee, Jihun Yun, Sung Ju Hwang +1
Network quantization, which aims to reduce the bit-lengths of the network weights and activations, has emerged for their deployments to resource-limited devices. Although recent st…
A General Family of Stochastic Proximal Gradient Methods for Deep Learning
Jihun Yun, Aurelie C. Lozano, Eunho Yang
We study the training of regularized neural networks where the regularizer can be non-smooth and non-convex. We propose a unified framework for stochastic proximal gradient descent…
Stochastic Gradient Methods with Block Diagonal Matrix Adaptation
Jihun Yun, Aurelie C. Lozano, Eunho Yang
Adaptive gradient approaches that automatically adjust the learning rate on a per-feature basis have been very popular for training deep networks. This rich class of algorithms inc…