PIEDet: Prototype-Driven Intrinsically Explainable Object Detection

Abstract

Existing object detectors typically make predictions in a black-box manner and struggle to simultaneously provide discriminative evidence for their predictions, which limits their deployment in safety-critical scenarios. To explain model predictions, existing post-hoc explanation methods mostly rely on gradient-based or perturbation-based operators. These methods not only introduce additional memory and computational overhead but also make it difficult to ensure that the generated explanations faithfully reflect the model's internal decision-making process. To address these limitations, we propose PIEDet, a prototype-driven intrinsically explainable object detection framework. PIEDet innovatively embeds class prototypes as explicit discriminative units into the classification branch of a one-stage detector, thereby improving detection performance while providing intrinsic interpretability. First, PIEDet constructs hierarchical class prototypes at different detection levels, enabling the model to learn scale-aware class-semantic representations. Second, we propose a prototype-driven feature learning method consisting of prototype regularization and a region-to-prototype matching loss. The former enhances the inter-class discriminability of the prototypes, while the latter encourages prototype responses to focus on object regions. Finally, we introduce a scale-aligned hierarchical prototype supervision mechanism that assigns scale-matched supervision signals to different detection levels, thereby enhancing the scale specificity of the hierarchical prototypes. On the ExDark, RTTS, and VOC2012-FOG datasets, PIEDet improves [email protected] over the baseline by 4.7%, 1.6%, and 4.8%, respectively, while demonstrating superior computational efficiency. Compared with mainstream post-hoc explanation methods, PIEDet achieves a better balance between explanation quality and explanation cost.

14 pages, 6 figures