ColBERT's [MASK]-based Query Augmentation: Effects of Quadrupling the Query Input Length

Ben Giacalone, Richard Zanibbi

A unique aspect of ColBERT is its use of [MASK] tokens in queries to score documents (query augmentation). Prior work shows [MASK] tokens weighting non-[MASK] query terms, emphasiz…