1 citations · 2 across the 5 of their papers we have counts for
4 papers · 1 filter
Data Management For Training Large Language Models: A Survey
Zige Wang, Wanjun Zhong, Yufei Wang +6
Data plays a fundamental role in training Large Language Models (LLMs). Efficient data management, particularly in formulating a well-suited training dataset, is significant for en…
Exploring the Usage of Chinese Pinyin in Pretraining
Baojun Wang, Kun Xu, Lifeng Shang
Unlike alphabetic languages, Chinese spelling and pronunciation are different. Both characters and pinyin take an important role in Chinese language understanding. In Chinese NLP t…
Zero-shot Cross-lingual Transfer without Parallel Corpus
Yuyang Zhang, Xiaofeng Han, Baojun Wang
Recently, although pre-trained language models have achieved great success on multilingual NLP (Natural Language Processing) tasks, the lack of training data on many tasks in low-r…
SELF: Self-Evolution with Language Feedback
Jianqiao Lu, Wanjun Zhong, Wenyong Huang +9
Large Language Models (LLMs) have demonstrated remarkable versatility across various domains. To further advance LLMs, we propose 'SELF' (Self-Evolution with Language Feedback), a…