Beyond Token Limits: Assessing Language Model Performance on Long Text Classification

Miklós Sebők, Viktor Kovács, Martin Bánóczy +3

The most widely used large language models in the social sciences (such as BERT, and its derivatives, e.g. RoBERTa) have a limitation on the input text length that they can process…