A Confidence-Diversity Framework for Calibrating AI Judgement in Accessible Qualitative Coding Tasks

Zhilong Zhao, Yindi Liu

LLMs enable qualitative coding at large scale, but assessing reliability remains challenging where human experts seldom agree. We investigate confidence-diversity calibration as a…