From the 1 of 3 linked papers with an AI index.
3 papers
DenseOn with the LateOn: Fully Open Dense and Late-Interaction Models for Multilingual, Long-Context, and Code Search
Raphaël Sourty, Antoine Chaffin, Paulo Roberto Moura Junior +1
The paper introduces an open-source pipeline for training dense and late-interaction retrieval models, builds large English and multilingual contrastive datasets, and releases two…
Rethinking the Multilingual Reasoning Gap with Layer Swap
Maxence Lasbordes, Amélie Chatelain, Djamé Seddah
Recent reasoning Large Language Models produce a chain-of-thought (CoT) predominantly in English, even when prompted in non-English languages. Prior work suggests that forcing the…
ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
Antoine Chaffin, Luca Arnaboldi, Amélie Chatelain +1
Current state-of-the-art multi-vector models are obtained through a small Knowledge Distillation (KD) training step on top of strong single-vector models, leveraging the large-scal…