activity
20192023
most citedRoFormer: Enhanced Transformer with Rotary Position Embedding

235 citations · 502 across the 8 of their papers we have counts for

collaborators

8 papers

cs.CL2023★ 2 cited

Rank-Aware Negative Training for Semi-Supervised Text Classification

Ahmed Murtadha, Shengfeng Pan, Wen Bo +4

Semi-supervised text classification-based paradigms (SSTC) typically employ the spirit of self-training. The key idea is to train a deep classifier on limited labeled texts and the…

cs.CL2022★ 66 cited

Global Pointer: Novel Efficient Span-based Approach for Named Entity Recognition

Jianlin Su, Ahmed Murtadha, Shengfeng Pan +5

Named entity recognition (NER) task aims at identifying entities from a piece of text that belong to predefined semantic types such as person, location, organization, etc. The stat…

cs.LG2022★ 26 cited

ZLPR: A Novel Loss for Multi-label Classification

Jianlin Su, Mingren Zhu, Ahmed Murtadha +3

In the era of deep learning, loss functions determine the range of tasks available to models and algorithms. To support the application of deep learning in multi-label classificati…

cs.CL2022★ 3 cited

BERT-ASC: Auxiliary-Sentence Construction for Implicit Aspect Learning in Sentiment Analysis

Murtadha Ahmed, Bo Wen, Shengfeng Pan +3

Aspect-based sentiment analysis (ABSA) aims to associate a text with a set of aspects and infer their respective sentimental polarities. State-of-the-art approaches are built on fi…

cs.SD2021★ 112 cited

Efficient Speech Emotion Recognition Using Multi-Scale CNN and Attention

Zixuan Peng, Yu Lu, Shengfeng Pan +1

Emotion recognition from speech is a challenging task. Re-cent advances in deep learning have led bi-directional recur-rent neural network (Bi-RNN) and attention mechanism as astan…

cs.CL2021★ 235 cited

RoFormer: Enhanced Transformer with Rotary Position Embedding

Jianlin Su, Yu Lu, Shengfeng Pan +3

Position encoding recently has shown effective in the transformer architecture. It enables valuable supervision for dependency modeling between elements at different positions of t…

cs.DB2020★ 16 cited

TableQA: a Large-Scale Chinese Text-to-SQL Dataset for Table-Aware SQL Generation

Ningyuan Sun, Xuefeng Yang, Yunfeng Liu

Parsing natural language to corresponding SQL (NL2SQL) with data driven approaches like deep neural networks attracts much attention in recent years. Existing NL2SQL datasets assum…

cs.CL2019★ 42 cited

Technical report on Conversational Question Answering

Ying Ju, Fubang Zhao, Shijie Chen +3

Conversational Question Answering is a challenging task since it requires understanding of conversational history. In this project, we propose a new system RoBERTa + AT +KD, which…