MetricBERT: Text Representation Learning via Self-Supervised Triplet Training

Itzik Malkiel, Dvir Ginzburg, Oren Barkan +3

We present MetricBERT, a BERT-based model that learns to embed text under a well-defined similarity metric while simultaneously adhering to the ``traditional'' masked-language task…