33 citations · 33 across the 5 of their papers we have counts for
5 papers · 1 filter
Selective Rotary Position Embedding
Sajad Movahedi, Timur Carstensen, Arshia Afzal +3
Position information is essential for language modeling. In softmax transformers, Rotary Position Embeddings (\textit{RoPE}) encode positions through \textit{fixed-angle} rotations…
Generative Adversarial Training Can Improve Neural Language Models
Sajad Movahedi, Azadeh Shakery
While deep learning in the form of recurrent neural networks (RNNs) has caused a significant improvement in neural language modeling, the fact that they are extremely prone to over…
NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer
Hossein Basafa, Sajad Movahedi, Ali Ebrahimi +2
This paper presents a technical report of our submission to the 4th task of SemEval-2021, titled: Reading Comprehension of Abstract Meaning. In this task, we want to predict the co…
Aspect Category Detection via Topic-Attention Network
Sajad Movahedi, Erfan Ghadery, Heshaam Faili +1
The e-commerce has started a new trend in natural language processing through sentiment analysis of user-generated reviews. Different consumers have different concerns about variou…
An Unsupervised Approach for Aspect Category Detection Using Soft Cosine Similarity Measure
Erfan Ghadery, Sajad Movahedi, Heshaam Faili +1
Aspect category detection is one of the important and challenging subtasks of aspect-based sentiment analysis. Given a set of pre-defined categories, this task aims to detect categ…