19 citations · 31 across the 6 of their papers we have counts for
10 papers
Facial Action Unit Detection and Intensity Estimation from Self-supervised Representation
Bowen Ma, Rudong An, Wei Zhang +6
As a fine-grained and local expression behavior measurement, facial action unit (FAU) analysis (e.g., detection and intensity estimation) has been documented for its time-consuming…
Probing Simile Knowledge from Pre-trained Language Models
Weijie Chen, Yongzhu Chang, Rongsheng Zhang +6
Simile interpretation (SI) and simile generation (SG) are challenging tasks for NLP because models require adequate world knowledge to produce predictions. Previous works have empl…
LaMemo: Language Modeling with Look-Ahead Memory
Haozhe Ji, Rongsheng Zhang, Zhenyu Yang +2
Although Transformers with fully connected self-attentions are powerful to model long-term dependencies, they are struggling to scale to long texts with thousands of words in langu…
DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks
Ziyang Luo, Yadong Xi, Jing Ma +4
Since 2017, the Transformer-based models play critical roles in various downstream Natural Language Processing tasks. However, a common limitation of the attention mechanism utiliz…
Youling: an AI-Assisted Lyrics Creation System
Rongsheng Zhang, Xiaoxi Mao, Le Li +6
Recently, a variety of neural models have been proposed for lyrics generation. However, most previous work completes the generation process in a single pass with little human inter…
Unsupervised Domain Adaptation with Adapter
Rongsheng Zhang, Yinhe Zheng, Xiaoxi Mao +1
Unsupervised domain adaptation (UDA) with pre-trained language models (PrLM) has achieved promising results since these pre-trained models embed generic knowledge learned from vari…