works on
domain adaptation 1in-car environment 1motion capture 1multimodal dataset 1sign language recognition 1

From the 1 of 3 linked papers with an AI index.

collaborators
Showing cs.AIShow all

1 paper · 1 filter

cs.AI2026

Entropy-aware Masking for Masked Language Modeling

Gokul Srinivasagan, Kai Hartung, Munir Georges

Masked language modeling has become a standard pretraining objective for training encoder-based language models. In this approach, certain tokens in the input are masked, and the m…