dense retrieval 1hard-negative mining 1knowledge distillation 1model compression 1score-only training 1
From the 1 of 2 linked papers with an AI index.
2 papers
cs.IR2026
Score-Only Distillation for Compact Dense Retrieval
Kirill Dubovikov, Martin Takac, Salem Lahlou
The paper proposes a method to compress large dense retrieval models into much smaller ones by distilling only the teacher's score vectors, using a row‑centered score‑vector object…
cs.IR2026
PETRA: Transforming Web Text for Petroleum-Engineering Domain Adaptation
Kirill Dubovikov, Omar El Mansouri, Hachem Madmoun +12
Petroleum-engineering search exposes a supervision gap for strong general retrievers: relevant evidence exists in public web text, but domain relevance labels are scarce. To addres…