1 citations · 2 across the 3 of their papers we have counts for
4 papers
Dynamic self-ensemble on multi-exit residual vision transformer for small-data image classification
Stephen Ekaputra Limantoro, Yan-Kai Wang, Ching-Chun Huang +4
Vision Transformer (ViT) has garnered increased attention for image classification in recent years. However, ViT is notorious for its data-hungry problem as it achieves high-perfor…
Enhancing Reconstruction Capability of Wavelet Transform Amorphous Radial Distribution Function via Machine Learning Assisted Parameter Tuning
Deriyan Senjaya, Stephen Ekaputra Limantoro
Understanding atomic structures is crucial, yet amorphous materials remain challenging due to their irregular and non-periodic nature. The Wavelet Transform Radial Distribution Fun…
Parameter-Free Logit Distillation via Sorting Mechanism
Stephen Ekaputra Limantoro
Knowledge distillation (KD) aims to distill the knowledge from the teacher (larger) to the student (smaller) model via soft-label for the efficient neural network. In general, the…
Swapped Logit Distillation via Bi-level Teacher Alignment
Stephen Ekaputra Limantoro, Jhe-Hao Lin, Chih-Yu Wang +4
Knowledge distillation (KD) compresses the network capacity by transferring knowledge from a large (teacher) network to a smaller one (student). It has been mainstream that the tea…