10 citations · 16 across the 3 of their papers we have counts for
3 papers
cs.LG2022★ 2 cited
MKQ-BERT: Quantized BERT with 4-bits Weights and Activations
Hanlin Tang, Xipeng Zhang, Kai Liu +2
Recently, pre-trained Transformer based language models, such as BERT, have shown great superiority over the traditional methods in many Natural Language Processing (NLP) tasks. Ho…
cs.CV2022★ 10 cited
Joint CNN and Transformer Network via weakly supervised Learning for efficient crowd counting
Fusen Wang, Kai Liu, Fei Long +3
Currently, for crowd counting, the fully supervised methods via density map estimation are the mainstream research directions. However, such methods need location-level annotation…
cs.CV2022★ 4 cited
Dynamic Group Transformer: A General Vision Transformer Backbone with Dynamic Group Attention
Kai Liu, Tianyi Wu, Cong Liu +1
Recently, Transformers have shown promising performance in various vision tasks. To reduce the quadratic computation complexity caused by each query attending to all keys/values, v…