2 papers
cs.AI2026
CDAE: Enhancing Perturbation Robustness in Pretrained Language Models with Contrastive Denoising
Sina Heydari, Amirreza Abbasi, Mohsen Hooshmand +1
Pre-trained language models have significantly improved sentence representation learning, yet their embedding remain sensitive to semantic preserving textual perturbations such as…
cs.LG2025
On the Universality of Transformer Architectures; How Much Attention Is Enough?
Amirreza Abbasi, Mohsen Hooshmand
Transformers are crucial across many AI fields, such as large language models, computer vision, and reinforcement learning. This prominence stems from the architecture's perceived…