Modular Expert Merging for Biomedical Retrieval

Sameh Khattab, Jean-Philippe Corbeil, Osman Alperen Çinar-Koraş +5

Adapting general-purpose LLMs into domain-specialized dense retrievers typically requires large-scale training on mixed-domain data. We show that merging independently trained doma…