2 papers
cs.CL2024
Word Order and World Knowledge
Qinghua Zhao, Vinit Ravishankar, Nicolas Garneau +1
Word order is an important concept in natural language, and in this work, we study how word order affects the induction of world knowledge from raw text using language models. We u…
cs.CL2024
Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings
Isabelle Mohr, Markus Krimmel, Saba Sturua +16
We introduce a novel suite of state-of-the-art bilingual text embedding models that are designed to support English and another target language. These models are capable of process…