Collaborative decoding of critical tokens for boosting factuality of large language models

Lifeng Jin, Baolin Peng, Linfeng Song +3

The most common training pipeline for large language models includes pretraining, finetuning and aligning phases, with their respective resulting models, such as the pretrained mod…