54 citations · 272 across the 29 of their papers we have counts for
11 papers · 1 filter
Reciprocal Normalization for Domain Adaptation
Zhiyong Huang, Kekai Sheng, Ke Li +5
Batch normalization (BN) is widely used in modern deep neural networks, which has been shown to represent the domain-related knowledge, and thus is ineffective for cross-domain tas…
RMNet: Equivalently Removing Residual Connection from Networks
Fanxu Meng, Hao Cheng, Jiaxin Zhuang +2
Although residual connection enables training very deep neural networks, it is not friendly for online inference due to its multi-branch topology. This encourages many researchers…
Private Language Model Adaptation for Speech Recognition
Zhe Liu, Ke Li, Shreyan Bakshi +1
Speech model adaptation is crucial to handle the discrepancy between server-side proxy training data and actual data received on local devices of users. With the use of federated l…
Regret Lower Bound and Optimal Algorithm for High-Dimensional Contextual Linear Bandit
Ke Li, Yun Yang, Naveen N. Narisetty
In this paper, we consider the multi-armed bandit problem with high-dimensional features. First, we prove a minimax lower bound, $\mathcal{O}\big((\log d)^{\frac{α+1}{2}}T^{\frac{1…
Fine-grained Data Distribution Alignment for Post-Training Quantization
Yunshan Zhong, Mingbao Lin, Mengzhao Chen +5
While post-training quantization receives popularity mostly due to its evasion in accessing the original complete training dataset, its poor performance also stems from scarce imag…
Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer
Yifan Xu, Zhijie Zhang, Mengdan Zhang +6
Vision transformers (ViTs) have recently received explosive popularity, but the huge computational cost is still a severe issue. Since the computation complexity of ViT is quadrati…