67 citations · 74 across the 5 of their papers we have counts for
3 papers · 1 filter
Resilient Practical Test-Time Adaptation: Soft Batch Normalization Alignment and Entropy-driven Memory Bank
Xingzhi Zhou, Zhiliang Tian, Ka Chun Cheung +2
Test-time domain adaptation effectively adjusts the source domain model to accommodate unseen domain shifts in a target domain during inference. However, the model performance can…
Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation
Dongkyu Lee, Ka Chun Cheung, Nevin L. Zhang
Overconfidence has been shown to impair generalization and calibration of a neural network. Previous studies remedy this issue by adding a regularization term to a loss function, p…
Understanding Top-k Sparsification in Distributed Deep Learning
Shaohuai Shi, Xiaowen Chu, Ka Chun Cheung +1
Distributed stochastic gradient descent (SGD) algorithms are widely deployed in training large-scale deep learning models, while the communication overhead among workers becomes th…