37 citations · 87 across the 12 of their papers we have counts for
12 papers
An Empirical Study of Consistency Regularization for End-to-End Speech-to-Text Translation
Pengzhi Gao, Ruiqing Zhang, Zhongjun He +2
Consistency regularization methods, such as R-Drop (Liang et al., 2021) and CrossConST (Gao et al., 2023), have achieved impressive supervised and zero-shot performance in the neur…
SMoA: Sparse Mixture of Adapters to Mitigate Multiple Dataset Biases
Yanchen Liu, Jing Yan, Yan Chen +2
Recent studies reveal that various biases exist in different NLP tasks, and over-reliance on biases results in models' poor generalization ability and low adversarial robustness. T…
ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization
Weixin Liu, Xuyi Chen, Jiaxiang Liu +4
Task-agnostic knowledge distillation attempts to address the problem of deploying large pretrained language model in resource-constrained scenarios by compressing a large pretraine…
Universal Information Extraction as Unified Semantic Matching
Jie Lou, Yaojie Lu, Dai Dai +5
The challenge of information extraction (IE) lies in the diversity of label schemas and the heterogeneity of structures. Traditional methods require task-specific model design and…
Towards Boosting the Open-Domain Chatbot with Human Feedback
Hua Lu, Siqi Bao, Huang He +3
Many open-domain dialogue models pre-trained with social media comments can generate coherent replies but have difficulties producing engaging responses when interacting with real…
GEM-2: Next Generation Molecular Property Prediction Network by Modeling Full-range Many-body Interactions
Lihang Liu, Donglong He, Xiaomin Fang +4
Molecular property prediction is a fundamental task in the drug and material industries. Physically, the properties of a molecule are determined by its own electronic structure, wh…