Tagger Evaluation Given Hierarchical Tag Sets

I. Dan Melamed, Philip Resnik

We present methods for evaluating human and automatic taggers that extend current practice in three ways. First, we show how to evaluate taggers that assign multiple tags to each t…