ViDeBERTa: A powerful pre-trained language model for Vietnamese

Cong Dao Tran, Nhut Huy Pham, Anh Nguyen +2

This paper presents ViDeBERTa, a new pre-trained monolingual language model for Vietnamese, with three versions - ViDeBERTa_xsmall, ViDeBERTa_base, and ViDeBERTa_large, which are p…