When is the consistent prediction likely to be a correct prediction?

Alex Nguyen, Dheeraj Mekala, Chengyu Dong +1

Self-consistency (Wang et al., 2023) suggests that the most consistent answer obtained through large language models (LLMs) is more likely to be correct. In this paper, we challeng…