1 citations · 2 across the 5 of their papers we have counts for
7 papers · 1 filter
EssayBench: Evaluating Large Language Models in Multi-Genre Chinese Essay Writing
Fan Gao, Dongyuan Li, Ding Xia +4
Chinese essay writing and its evaluation are critical in educational contexts, yet the capabilities of Large Language Models (LLMs) in this domain remain largely underexplored. Exi…
Pangu Ultra: Pushing the Limits of Dense Large Language Models on Ascend NPUs
Yichun Yin, Wenyong Huang, Kaikai Song +49
We present Pangu Ultra, a Large Language Model (LLM) with 135 billion parameters and dense Transformer modules trained on Ascend Neural Processing Units (NPUs). Although the field…
YODA: Teacher-Student Progressive Learning for Language Models
Jianqiao Lu, Wanjun Zhong, Yufei Wang +10
Although large language models (LLMs) have demonstrated adeptness in a range of tasks, they still lag behind human learning efficiency. This disparity is often linked to the inhere…
Data Management For Training Large Language Models: A Survey
Zige Wang, Wanjun Zhong, Yufei Wang +6
Data plays a fundamental role in training Large Language Models (LLMs). Efficient data management, particularly in formulating a well-suited training dataset, is significant for en…
Exploring the Usage of Chinese Pinyin in Pretraining
Baojun Wang, Kun Xu, Lifeng Shang
Unlike alphabetic languages, Chinese spelling and pronunciation are different. Both characters and pinyin take an important role in Chinese language understanding. In Chinese NLP t…
Zero-shot Cross-lingual Transfer without Parallel Corpus
Yuyang Zhang, Xiaofeng Han, Baojun Wang
Recently, although pre-trained language models have achieved great success on multilingual NLP (Natural Language Processing) tasks, the lack of training data on many tasks in low-r…