Pooling Attention: Evaluating Pretrained Transformer Embeddings for Deception Classification

Sumit Mamtani, Abhijeet Bhure

This paper investigates fake news detection as a downstream evaluation of Transformer representations, benchmarking encoder-only and decoder-only pre-trained models (BERT, GPT-2, T…