Boolean-aware Attention for Dense Retrieval

Quan Mai, Susan Gauch, Douglas Adams

We present Boolean-aware attention, a novel attention mechanism that dynamically adjusts token focus based on Boolean operators (e.g., and, or, not). Our model employs specialized…