From the 1 of 4 linked papers with an AI index.
4 papers
Score-Only Distillation for Compact Dense Retrieval
Kirill Dubovikov, Martin Takac, Salem Lahlou
The paper proposes a method to compress large dense retrieval models into much smaller ones by distilling only the teacher's score vectors, using a row‑centered score‑vector object…
PETRA: Transforming Web Text for Petroleum-Engineering Domain Adaptation
Kirill Dubovikov, Omar El Mansouri, Hachem Madmoun +12
Petroleum-engineering search exposes a supervision gap for strong general retrievers: relevant evidence exists in public web text, but domain relevance labels are scarce. To addres…
Enhancing BERT Fine-Tuning for Sentiment Analysis in Lower-Resourced Languages
Jozef KubÃk, Marek Å uppa, Martin TakáÄ
Limited data for low-resource languages typically yield weaker language models (LMs). Since pre-training is compute-intensive, it is more pragmatic to target improvements during fi…
MedNNS: Supernet-based Medical Task-Adaptive Neural Network Search
Lotfi Abdelkrim Mecharbat, Ibrahim Almakky, Martin Takac +1
Deep learning (DL) has achieved remarkable progress in the field of medical imaging. However, adapting DL models to medical tasks remains a significant challenge, primarily due to…