Transformer over Pre-trained Transformer for Neural Text Segmentation with Enhanced Topic Coherence

Kelvin Lo, Yuan Jin, Weicong Tan +3

This paper proposes a transformer over transformer framework, called Transformer${}^2$, to perform neural text segmentation. It consists of two components: bottom-level sentence enco…