activity
20202022
most citedComparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation

14 citations · 25 across the 5 of their papers we have counts for

collaborators

6 papers

cs.CV20223 cited

Region-Conditioned Orthogonal 3D U-Net for Weather4Cast Competition

Taehyeon Kim, Shinhwan Kang, Hyeonjeong Shin +4

The Weather4Cast competition (hosted by NeurIPS 2022) required competitors to predict super-resolution rain movies in various regions of Europe when low-resolution satellite contex…

cs.LG2022

Mold into a Graph: Efficient Bayesian Optimization over Mixed-Spaces

Jaeyeon Ahn, Taehyeon Kim, Seyoung Yun

Real-world optimization problems are generally not just black-box problems, but also involve mixed types of inputs in which discrete and continuous variables coexist. Such mixed-sp…

cs.LG202114 cited

Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation

Taehyeon Kim, Jaehoon Oh, NakYil Kim +2

Knowledge distillation (KD), transferring knowledge from a cumbersome teacher model to a lightweight student model, has been investigated to design efficient neural architectures.…

cs.LG2021

FINE Samples for Learning with Noisy Labels

Taehyeon Kim, Jongwoo Ko, Sangwook Cho +2

Modern deep neural networks (DNNs) become frail when the datasets contain noisy (incorrect) class labels. Robust techniques in the presence of noisy labels can be categorized into…

cs.LG20203 cited

Adaptive Local Bayesian Optimization Over Multiple Discrete Variables

Taehyeon Kim, Jaeyeon Ahn, Nakyil Kim +1

In the machine learning algorithms, the choice of the hyperparameter is often an art more than a science, requiring labor-intensive search with expert experience. Therefore, automa…

cs.LG20205 cited

Accurate and Fast Federated Learning via Combinatorial Multi-Armed Bandits

Taehyeon Kim, Sangmin Bae, Jin-woo Lee +1

Federated learning has emerged as an innovative paradigm of collaborative machine learning. Unlike conventional machine learning, a global model is collaboratively learned while da…