25 citations · 132 across the 68 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
MoLEx: Mixture of Layer Experts for Finetuning with Sparse Upcycling
Rachel S. Y. Teo, Tan M. Nguyen
Large-scale pre-training of deep models, followed by fine-tuning them, has become the cornerstone of natural language processing (NLP). The prevalence of data coupled with computat…
cs.CL2023
Mitigating Over-smoothing in Transformers via Regularized Nonlocal Functionals
Tam Nguyen, Tan M. Nguyen, Richard G. Baraniuk
Transformers have achieved remarkable success in a wide range of natural language processing and computer vision applications. However, the representation capacity of a deep transf…