4 citations · 7 across the 4 of their papers we have counts for
6 papers · 1 filter
Hy-MT2: A Family of Fast, Efficient and Powerful Multilingual Translation Models in the Wild
Mao Zheng, Zheng Li, Tao Chen +10
Hy-MT2 is a family of fast-thinking multilingual translation models designed for complex real-world scenarios. It includes three model sizes: 1.8B, 7B, and 30B-A3B (MoE), all of wh…
Knowledge Efficient Deep Learning for Natural Language Processing
Hai Wang
Deep learning has become the workhorse for a wide range of natural language processing applications. But much of the success of deep learning relies on annotated examples. Annotati…
On-The-Fly Information Retrieval Augmentation for Language Models
Hai Wang, David McAllester
Here we experiment with the use of information retrieval as an augmentation for pre-trained language models. The text corpus used in information retrieval can be viewed as form of…
Improving Pre-Trained Multilingual Models with Vocabulary Expansion
Hai Wang, Dian Yu, Kai Sun +2
Recently, pre-trained language models have achieved remarkable success in a broad range of natural language processing tasks. However, in multilingual setting, it is extremely reso…
Evidence Sentence Extraction for Machine Reading Comprehension
Hai Wang, Dian Yu, Kai Sun +4
Remarkable success has been achieved in the last few years on some limited machine reading comprehension (MRC) tasks. However, it is still difficult to interpret the predictions of…
Deep Probabilistic Logic: A Unifying Framework for Indirect Supervision
Hai Wang, Hoifung Poon
Deep learning has emerged as a versatile tool for a wide range of NLP tasks, due to its superior capacity in representation learning. But its applicability is limited by the relian…