40 citations · 50 across the 13 of their papers we have counts for
4 papers · 1 filter
MC: Towards Transparent and Culturally-Aware NLP for Minority Languages in China
Chen Zhang, Mingxu Tao, Quzhe Huang +3
Current large language models demonstrate deficiencies in understanding low-resource languages, particularly the minority languages in China. This limitation stems from the scarcit…
A Frustratingly Easy Improvement for Position Embeddings via Random Padding
Mingxu Tao, Yansong Feng, Dongyan Zhao
Position embeddings, encoding the positional relationships among tokens in text sequences, make great contributions to modeling local context features in Transformer-based pre-trai…
Lawyer LLaMA Technical Report
Quzhe Huang, Mingxu Tao, Chen Zhang +5
Large Language Models (LLMs), like LLaMA, have exhibited remarkable performance across various tasks. Nevertheless, when deployed to specific domains such as law or medicine, the m…
Can BERT Refrain from Forgetting on Sequential Tasks? A Probing Study
Mingxu Tao, Yansong Feng, Dongyan Zhao
Large pre-trained language models help to achieve state of the art on a variety of natural language processing (NLP) tasks, nevertheless, they still suffer from forgetting when inc…