activity
20192025
most citedBERT Loses Patience: Fast and Robust Inference with Early Exit

45 citations · 193 across the 32 of their papers we have counts for

collaborators
Showing 2022Show all

8 papers · 1 filter

cs.CL2022★ 2 cited

Pay Attention to Your Tone: Introducing a New Dataset for Polite Language Rewrite

Xun Wang, Tao Ge, Allen Mao +3

We introduce \textsc{PoliteRewrite} -- a dataset for polite language rewrite which is a novel sentence rewrite task. Compared with previous text style transfer tasks that can be mo…

cs.CL2022★ 3 cited

Extensible Prompts for Language Models on Zero-shot Language Style Customization

Tao Ge, Jing Hu, Li Dong +5

We propose eXtensible Prompt (X-Prompt) for prompting a large language model (LLM) beyond natural language (NL). X-Prompt instructs an LLM with not only NL but also an extensible v…

physics.ao-ph2022

DL-Corrector-Remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting

Tao Ge, Jaideep Pathak, Akshay Subramaniam +1

Data-driven models, such as FourCastNet (FCN), have shown exemplary performance in high-resolution global weather forecasting. This performance, however, is based on supervision on…

cs.CL2022★ 6 cited

Lossless Acceleration for Seq2seq Generation with Aggressive Decoding

Tao Ge, Heming Xia, Xin Sun +2

We study lossless acceleration for seq2seq generation with a novel decoding algorithm -- Aggressive Decoding. Unlike the previous efforts (e.g., non-autoregressive decoding) speedi…

cs.CL2022★ 2 cited

Text Revision by On-the-Fly Representation Optimization

Jingjing Li, Zichao Li, Tao Ge +2

Text revision refers to a family of natural language generation tasks, where the source and target sequences share moderate resemblance in surface form but differentiate in attribu…

cs.CL2022★ 2 cited

Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation

Heming Xia, Tao Ge, Peiyi Wang +3

We propose Speculative Decoding (SpecDec), for the first time ever, to formally study exploiting the idea of speculative execution to accelerate autoregressive (AR) decoding. Specu…

cs.CL2022

EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation

Tao Ge, Si-Qing Chen, Furu Wei

We introduce EdgeFormer -- a parameter-efficient Transformer for on-device seq2seq generation under the strict computation and memory constraints. Compared with the previous parame…

cs.CL2022★ 3 cited

A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model

Xin Sun, Tao Ge, Shuming Ma +3

Synthetic data construction of Grammatical Error Correction (GEC) for non-English languages relies heavily on human-designed and language-specific rules, which produce limited erro…