5 citations · 6 across the 3 of their papers we have counts for
3 papers
eess.SP2023
Sleep Model -- A Sequence Model for Predicting the Next Sleep Stage
Iksoo Choi, Wonyong Sung
As sleep disorders are becoming more prevalent there is an urgent need to classify sleep stages in a less disturbing way.In particular, sleep-stage classification using simple sens…
cs.CL2021★ 1 cited
Layer-wise Pruning of Transformer Attention Heads for Efficient Language Modeling
Kyuhong Shim, Iksoo Choi, Wonyong Sung +1
While Transformer-based models have shown impressive language modeling performance, the large computation cost is often prohibitive for practical use. Attention head pruning, which…
cs.LG2020★ 5 cited
S-SGD: Symmetrical Stochastic Gradient Descent with Weight Noise Injection for Reaching Flat Minima
Wonyong Sung, Iksoo Choi, Jinhwan Park +2
The stochastic gradient descent (SGD) method is most widely used for deep neural network (DNN) training. However, the method does not always converge to a flat minimum of the loss…