Integrative Decoding: Improve Factuality via Implicit Self-consistency

Yi Cheng, Xiao Liang, Yeyun Gong +11

Self-consistency-based approaches, which involve repeatedly sampling multiple outputs and selecting the most consistent one as the final response, prove to be remarkably effective…