Granular Change Accuracy: A More Accurate Performance Metric for Dialogue State Tracking

Taha Aksu, Nancy F. Chen

Current metrics for evaluating Dialogue State Tracking (DST) systems exhibit three primary limitations. They: i) erroneously presume a uniform distribution of slots throughout the…