6 citations · 13 across the 5 of their papers we have counts for
5 papers
EA-KD: Entropy-based Adaptive Knowledge Distillation
Chi-Ping Su, Ching-Hsun Tseng, Bin Pu +4
Knowledge distillation (KD) enables a smaller "student" model to mimic a larger "teacher" model by transferring knowledge from the teacher's output or features. However, most KD me…
A Novel Method of Fuzzy Topic Modeling based on Transformer Processing
Ching-Hsun Tseng, Shin-Jye Lee, Po-Wei Cheng +2
Topic modeling is admittedly a convenient way to monitor markets trend. Conventionally, Latent Dirichlet Allocation, LDA, is considered a must-do model to gain this type of informa…
Real-time Automatic M-mode Echocardiography Measurement with Panel Attention from Local-to-Global Pixels
Ching-Hsun Tseng, Shao-Ju Chien, Po-Shen Wang +4
Motion mode (M-mode) recording is an essential part of echocardiography to measure cardiac dimension and function. However, the current diagnosis cannot build an automatic scheme,…
Perturbated Gradients Updating within Unit Space for Deep Learning
Ching-Hsun. Tseng, Liu-Hsueh. Cheng, Shin-Jye. Lee +1
In deep learning, optimization plays a vital role. By focusing on image classification, this work investigates the pros and cons of the widely used optimizers, and proposes a new o…
UPANets: Learning from the Universal Pixel Attention Networks
Ching-Hsun Tseng, Shin-Jye Lee, Jia-Nan Feng +5
Among image classification, skip and densely-connection-based networks have dominated most leaderboards. Recently, from the successful development of multi-head attention in natura…