contrastive learning 1denoising autoencoder 1perturbation robustness 1pretrained language models 1sentence embeddings 1
From the 1 of 2 linked papers with an AI index.
2 papers
cs.AI2026
CDAE: Enhancing Perturbation Robustness in Pretrained Language Models with Contrastive Denoising
Sina Heydari, Amirreza Abbasi, Mohsen Hooshmand +1
The paper introduces a lightweight Contrastive Denoising Autoencoder (CDAE) that refines BERT sentence embeddings to be more robust against semantic-preserving perturbations by joi…
cs.LG2025
On the Universality of Transformer Architectures; How Much Attention Is Enough?
Amirreza Abbasi, Mohsen Hooshmand
Transformers are crucial across many AI fields, such as large language models, computer vision, and reinforcement learning. This prominence stems from the architecture's perceived…