activity
20162022
most citedA Structured Self-attentive Sentence Embedding

1.5k citations · 1.7k across the 12 of their papers we have counts for

collaborators

16 papers

cs.CL2022

Text Editing as Imitation Game

Ning Shi, Bin Tang, Bo Yuan +4

Text editing, such as grammatical error correction, arises naturally from imperfect textual data. Recent works frame text editing as a multi-round sequence tagging task, where oper…

cs.CL2022

Syntax-guided Localized Self-attention by Constituency Syntactic Distance

Shengyuan Hou, Jushi Kai, Haotian Xue +5

Recent works have revealed that Transformers are implicitly learning the syntactic information in its lower layers from data, albeit is highly dependent on the quality and scale of…

cs.CL20221 cited

INFINITY: A Simple Yet Effective Unsupervised Framework for Graph-Text Mutual Conversion

Yi Xu, Luoyi Fu, Zhouhan Lin +2

Graph-to-text (G2T) generation and text-to-graph (T2G) triple extraction are two essential tasks for constructing and applying knowledge graphs. Existing unsupervised approaches tu…

cs.CL2022

Transkimmer: Transformer Learns to Layer-wise Skim

Yue Guan, Zhengyi Li, Jingwen Leng +2

Transformer architecture has become the de-facto model for many machine learning tasks from natural language processing and computer vision. As such, improving its computational ef…

cs.SD2022

Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition

Xichen Pan, Peiyu Chen, Yichen Gong +3

Training Transformer-based models demands a large amount of data, while obtaining aligned and labelled data in multimodality is rather cost-demanding, especially for audio-visual s…

cs.CL20219 cited

Incorporating External POS Tagger for Punctuation Restoration

Ning Shi, Wei Wang, Boxin Wang +3

Punctuation restoration is an important post-processing step in automatic speech recognition. Among other kinds of external information, part-of-speech (POS) taggers provide inform…