19 citations · 19 across the 5 of their papers we have counts for
5 papers
Elucidating Subspace Perturbation in Zeroth-Order Optimization: Theory and Practice at Scale
Sihwan Park, Jihun Yun, SungYub Kim +2
Zeroth-order (ZO) optimization has emerged as a promising alternative to gradient-based backpropagation methods, particularly for black-box optimization and large language model (L…
TTD: Text-Tag Self-Distillation Enhancing Image-Text Alignment in CLIP to Alleviate Single Tag Bias
Sanghyun Jo, Soohyun Ryu, Sungyub Kim +2
We identify a critical bias in contemporary CLIP-based models, which we denote as single tag bias. This bias manifests as a disproportionate focus on a singular tag (word) while ne…
Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel
SungYub Kim, Sihwan Park, Kyungsu Kim +1
Explaining generalizations and preventing over-confident predictions are central goals of studies on the loss landscape of neural networks. Flatness, defined as loss invariability…
Reliable Estimation of Individual Treatment Effect with Causal Information Bottleneck
Sungyub Kim, Yongsu Baek, Sung Ju Hwang +1
Estimating individual level treatment effects (ITE) from observational data is a challenging and important area in causal machine learning and is commonly considered in diverse mis…
Tsallis Reinforcement Learning: A Unified Framework for Maximum Entropy Reinforcement Learning
Kyungjae Lee, Sungyub Kim, Sungbin Lim +2
In this paper, we present a new class of Markov decision processes (MDPs), called Tsallis MDPs, with Tsallis entropy maximization, which generalizes existing maximum entropy reinfo…