activity
20212023
most citedRoFormer: Enhanced Transformer with Rotary Position Embedding

235 citations · 461 across the 9 of their papers we have counts for

collaborators

9 papers

cs.AI2023★ 11 cited

The Troubling Emergence of Hallucination in Large Language Models -- An Extensive Definition, Quantification, and Prescriptive Remediations

Vipula Rawte, Swagata Chakraborty, Agnibh Pathak +5

The recent advancements in Large Language Models (LLMs) have garnered widespread acclaim for their remarkable emerging capabilities. However, the issue of hallucination has paralle…

cs.CL2023★ 2 cited

Rank-Aware Negative Training for Semi-Supervised Text Classification

Ahmed Murtadha, Shengfeng Pan, Wen Bo +4

Semi-supervised text classification-based paradigms (SSTC) typically employ the spirit of self-training. The key idea is to train a deep classifier on limited labeled texts and the…

cs.CL2022★ 66 cited

Global Pointer: Novel Efficient Span-based Approach for Named Entity Recognition

Jianlin Su, Ahmed Murtadha, Shengfeng Pan +5

Named entity recognition (NER) task aims at identifying entities from a piece of text that belong to predefined semantic types such as person, location, organization, etc. The stat…

cs.LG2022★ 26 cited

ZLPR: A Novel Loss for Multi-label Classification

Jianlin Su, Mingren Zhu, Ahmed Murtadha +3

In the era of deep learning, loss functions determine the range of tasks available to models and algorithms. To support the application of deep learning in multi-label classificati…

cs.CL2022★ 3 cited

BERT-ASC: Auxiliary-Sentence Construction for Implicit Aspect Learning in Sentiment Analysis

Murtadha Ahmed, Bo Wen, Shengfeng Pan +3

Aspect-based sentiment analysis (ABSA) aims to associate a text with a set of aspects and infer their respective sentimental polarities. State-of-the-art approaches are built on fi…

cs.LG2021★ 6 cited

Sparse-softmax: A Simpler and Faster Alternative Softmax Transformation

Shaoshi Sun, Zhenyuan Zhang, BoCheng Huang +4

The softmax function is widely used in artificial neural networks for the multiclass classification problems, where the softmax transformation enforces the output to be positive an…

cs.CL2021

BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq Models

Yi Liu, Guoan Zhang, Puning Yu +2

Copy mechanisms explicitly obtain unchanged tokens from the source (input) sequence to generate the target (output) sequence under the neural seq2seq framework. However, most of th…

cs.SD2021★ 112 cited

Efficient Speech Emotion Recognition Using Multi-Scale CNN and Attention

Zixuan Peng, Yu Lu, Shengfeng Pan +1

Emotion recognition from speech is a challenging task. Re-cent advances in deep learning have led bi-directional recur-rent neural network (Bi-RNN) and attention mechanism as astan…

cs.CL2021★ 235 cited

RoFormer: Enhanced Transformer with Rotary Position Embedding

Jianlin Su, Yu Lu, Shengfeng Pan +3

Position encoding recently has shown effective in the transformer architecture. It enables valuable supervision for dependency modeling between elements at different positions of t…