Probing the 3D Object-Level Understanding of Pre-Trained Detection Transformers

Robin Kim, Colin Samplawski, Benjamin M. Marlin

Detection transformer models, including DETR and its extensions, learn to output a set of object-level embeddings that can be simultaneously decoded into 2D bounding boxes and clas…