5 citations · 20 across the 12 of their papers we have counts for
8 papers · 1 filter
CMV-BERT: Contrastive multi-vocab pretraining of BERT
Wei Zhu, Daniel Cheung
In this work, we represent CMV-BERT, which improves the pretraining of a language model via two ingredients: (a) contrastive learning, which is well studied in the area of computer…
MVP-BERT: Redesigning Vocabularies for Chinese BERT and Multi-Vocab Pretraining
Wei Zhu
Despite the development of pre-trained language models (PLMs) significantly raise the performances of various Chinese natural language processing (NLP) tasks, the vocabulary for th…
Predicting Parkinson's Disease with Multimodal Irregularly Collected Longitudinal Smartphone Data
Weijian Li, Wei Zhu, E. Ray Dorsey +1
Parkinsons Disease is a neurological disorder and prevalent in elderly people. Traditional ways to diagnose the disease rely on in-person subjective clinical evaluations on the qua…
AutoRC: Improving BERT Based Relation Classification Models via Architecture Search
Wei Zhu, Xipeng Qiu, Yuan Ni +1
Although BERT based relation classification (RC) models have achieved significant improvements over the traditional deep learning models, it seems that no consensus can be reached…
AutoTrans: Automating Transformer Design via Reinforced Architecture Search
Wei Zhu, Xiaoling Wang, Xipeng Qiu +2
Though the transformer architectures have shown dominance in many natural language understanding tasks, there are still unsolved issues for the training of transformer models, espe…
Personalized Fashion Recommendation from Personal Social Media Data: An Item-to-Set Metric Learning Approach
Haitian Zheng, Kefei Wu, Jong-Hwi Park +2
With the growth of online shopping for fashion products, accurate fashion recommendation has become a critical problem. Meanwhile, social networks provide an open and new data sour…