Guard Models Are Overconfident Where Base Models Are Uncertain

Jonghyun Hong, MinJae Jung, Minwoo Kim

Guard models are used as safety classifiers, with confidence scores driving downstream moderation decisions. We evaluate five guard models for prompt classification and find that a…