11 citations · 42 across the 19 of their papers we have counts for
13 papers · 1 filter
OpenBA: An Open-sourced 15B Bilingual Asymmetric seq2seq Model Pre-trained from Scratch
Juntao Li, Zecheng Tang, Yuyang Ding +9
Large language models (LLMs) with billions of parameters have demonstrated outstanding performance on various natural language processing tasks. This report presents OpenBA, an ope…
Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operation
Xinshuo Hu, Dongfang Li, Baotian Hu +3
Large language models (LLMs) have been widely used in various applications but are known to suffer from issues related to untruthfulness and toxicity. While parameter-efficient mod…
Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm
Hexuan Deng, Xin Zhang, Meishan Zhang +2
In this paper, we conduct a holistic exploration of the Universal Decompositional Semantic (UDS) Parsing. We first introduce a cascade model for UDS parsing that decomposes the com…
Generative Multimodal Entity Linking
Senbao Shi, Zhenran Xu, Baotian Hu +1
Multimodal Entity Linking (MEL) is the task of mapping mentions with multimodal contexts to the referent entities from a knowledge base. Existing MEL methods mainly focus on design…
A Pilot Study on Dialogue-Level Dependency Parsing for Chinese
Gongyao Jiang, Shuang Liu, Meishan Zhang +1
Dialogue-level dependency parsing has received insufficient attention, especially for Chinese. To this end, we draw on ideas from syntactic dependency and rhetorical structure theo…
Toward Adversarial Training on Contextualized Language Representation
Hongqiu Wu, Yongxiang Liu, Hanwen Shi +2
Beyond the success story of adversarial training (AT) in the recent text domain on top of pre-trained language models (PLMs), our empirical study showcases the inconsistent gains f…