11 citations · 25 across the 8 of their papers we have counts for
4 papers · 1 filter
AttriCLIP: A Non-Incremental Learner for Incremental Knowledge Learning
Runqi Wang, Xiaoyue Duan, Guoliang Kang +5
Continual learning aims to enable a model to incrementally learn knowledge from sequentially arrived data. Previous works adopt the conventional classification architecture, which…
IDa-Det: An Information Discrepancy-aware Distillation for 1-bit Detectors
Sheng Xu, Yanjing Li, Bohan Zeng +5
Knowledge distillation (KD) has been proven to be useful for training compact object detection models. However, we observe that KD is often effective when the teacher model and stu…
Recurrent Bilinear Optimization for Binary Neural Networks
Sheng Xu, Yanjing Li, Tiancheng Wang +6
Binary Neural Networks (BNNs) show great promise for real-world embedded devices. As one of the critical steps to achieve a powerful BNN, the scale factor calculation plays an esse…
TerViT: An Efficient Ternary Vision Transformer
Sheng Xu, Yanjing Li, Teli Ma +4
Vision transformers (ViTs) have demonstrated great potential in various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-con…