6 citations · 7 across the 4 of their papers we have counts for
4 papers
Exploring Transformer Extrapolation
Zhen Qin, Yiran Zhong, Hui Deng
Length extrapolation has attracted considerable attention recently since it allows transformers to be tested on longer sequences than those used in training. Previous research has…
Vicinity Vision Transformer
Weixuan Sun, Zhen Qin, Hui Deng +7
Vision transformers have shown great success on numerous computer vision tasks. However, its central component, softmax attention, prohibits vision transformers from scaling up to…
Multimodal-Aware Weakly Supervised Metric Learning with Self-weighting Triplet Loss
Huiyuan Deng, Xiangzhu Meng, Lin Feng
In recent years, we have witnessed a surge of interests in learning a suitable distance metric from weakly supervised data. Most existing methods aim to pull all the similar sample…
DELTA: A DEep learning based Language Technology plAtform
Kun Han, Junwen Chen, Hui Zhang +20
In this paper we present DELTA, a deep learning based language technology platform. DELTA is an end-to-end platform designed to solve industry level natural language and speech pro…