244 citations · 480 across the 41 of their papers we have counts for
12 papers · 1 filter
TexSmart: A Text Understanding System for Fine-Grained NER and Enhanced Semantic Analysis
Haisong Zhang, Lemao Liu, Haiyun Jiang +14
This technique report introduces TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. Com…
Dialogue Response Selection with Hierarchical Curriculum Learning
Yixuan Su, Deng Cai, Qingyu Zhou +6
We study the learning of a matching model for dialogue response selection. Motivated by the recent finding that models trained with random negative samples are not ideal in real-wo…
Empirical Analysis of Unlabeled Entity Problem in Named Entity Recognition
Yangming Li, Lemao Liu, Shuming Shi
In many scenarios, named entity recognition (NER) models severely suffer from unlabeled entity problem, where the entities of a sentence may not be fully annotated. Through empiric…
Segmenting Natural Language Sentences via Lexical Unit Analysis
Yangming Li, Lemao Liu, Shuming Shi
In this work, we present Lexical Unit Analysis (LUA), a framework for general sequence segmentation tasks. Given a natural language sentence, LUA scores all the valid segmentation…
When Hearst Is not Enough: Improving Hypernymy Detection from Corpus with Distributional Models
Changlong Yu, Jialong Han, Peifeng Wang +4
We address hypernymy detection, i.e., whether an is-a relationship exists between words (x, y), with the help of large textual corpora. Most conventional approaches to this task ha…
On the Sub-Layer Functionalities of Transformer Decoder
Yilin Yang, Longyue Wang, Shuming Shi +3
There have been significant efforts to interpret the encoder of Transformer-based encoder-decoder architectures for neural machine translation (NMT); meanwhile, the decoder remains…
Evaluating Explanation Methods for Neural Machine Translation
Jierui Li, Lemao Liu, Huayang Li +3
Recently many efforts have been devoted to interpreting the black-box NMT models, but little progress has been made on metrics to evaluate explanation methods. Word Alignment Error…
On the Inference Calibration of Neural Machine Translation
Shuo Wang, Zhaopeng Tu, Shuming Shi +1
Confidence calibration, which aims to make model predictions equal to the true correctness measures, is important for neural machine translation (NMT) because it is able to offer u…
Understanding Learning Dynamics for Neural Machine Translation
Conghui Zhu, Guanlin Li, Lemao Liu +2
Despite the great success of NMT, there still remains a severe challenge: it is hard to interpret the internal dynamics during its training process. In this paper we propose to und…
Detecting and Understanding Generalization Barriers for Neural Machine Translation
Guanlin Li, Lemao Liu, Conghui Zhu +2
Generalization to unseen instances is our eternal pursuit for all data-driven models. However, for realistic task like machine translation, the traditional approach measuring gener…
SongNet: Rigid Formats Controlled Text Generation
Piji Li, Haisong Zhang, Xiaojiang Liu +1
Neural text generation has made tremendous progress in various tasks. One common characteristic of most of the tasks is that the texts are not restricted to some rigid formats when…
The World is Not Binary: Learning to Rank with Grayscale Data for Dialogue Response Selection
Zibo Lin, Deng Cai, Yan Wang +3
Response selection plays a vital role in building retrieval-based conversation systems. Despite that response selection is naturally a learning-to-rank problem, most prior works ta…