13 citations · 20 across the 5 of their papers we have counts for
6 papers
Better Language Model with Hypernym Class Prediction
He Bai, Tong Wang, Alessandro Sordoni +1
Class-based language models (LMs) have been long devised to address context sparsity in -gram LMs. In this study, we revisit this approach in the context of neural LMs. We hypot…
Hierarchical Character Tagger for Short Text Spelling Error Correction
Mengyi Gao, Canran Xu, Peng Shi
State-of-the-art approaches to spelling error correction problem include Transformer-based Seq2Seq models, which require large training sets and suffer from slow inference time; an…
Mr. TyDi: A Multi-lingual Benchmark for Dense Retrieval
Xinyu Zhang, Xueguang Ma, Peng Shi +1
We present Mr. TyDi, a multi-lingual benchmark dataset for mono-lingual retrieval in eleven typologically diverse languages, designed to evaluate ranking with learned dense represe…
End-to-End Cross-Domain Text-to-SQL Semantic Parsing with Auxiliary Task
Peng Shi, Tao Yu, Patrick Ng +1
In this work, we focus on two crucial components in the cross-domain text-to-SQL semantic parsing task: schema linking and value filling. To encourage the model to learn better enc…
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training
Peng Shi, Patrick Ng, Zhiguo Wang +5
Most recently, there has been significant interest in learning contextual representations for various NLP tasks, by leveraging large scale text corpora to train large neural langua…
Segatron: Segment-Aware Transformer for Language Modeling and Understanding
He Bai, Peng Shi, Jimmy Lin +5
Transformers are powerful for sequence modeling. Nearly all state-of-the-art language models and pre-trained language models are based on the Transformer architecture. However, it…