HyPAC: Cost-Efficient LLMs-Human Hybrid Annotation with PAC Error Guarantees

Hao Zeng, Huipeng Huang, Xinhao Qu +3

Data annotation often involves multiple sources with different cost-quality trade-offs, such as fast large language models (LLMs), slow reasoning models, and human experts. In this…