A Split-then-Join Approach to Abstractive Summarization for Very Long Documents in a Low Resource Setting

Lhuqita Fazry

$\text{BIGBIRD-PEGASUS}$ model achieves $\text{state-of-the-art}$ on abstractive text summarization for long documents. However it's capacity still limited to maximum of $4,096…