activity
20192023
most citedExtending the Pre-Training of BLOOM for Improved Support of Traditional Chinese: Models, Methods and Results

2 citations · 4 across the 8 of their papers we have counts for

collaborators
Showing 2021Show all

2 papers · 1 filter

cs.CL2021

Roof-Transformer: Divided and Joined Understanding with Knowledge Enhancement

Wei-Lin Liao, Cheng-En Su, Wei-Yun Ma

Recent work on enhancing BERT-based language representation models with knowledge graphs (KGs) and knowledge bases (KBs) has yielded promising results on multiple NLP tasks. State-…

cs.CL2021

DCT: Dynamic Compressive Transformer for Modeling Unbounded Sequence

Kai-Po Chang, Wei-Yun Ma

In this paper, we propose Dynamic Compressive Transformer (DCT), a transformer-based framework for modeling the unbounded sequence. In contrast to the previous baselines which appe…