410 citations · 844 across the 13 of their papers we have counts for
16 papers
Gemini Embedding 2: A Native Multimodal Embedding Model from Gemini
Madhuri Shanbhogue, Zhe Li, Shanfeng Zhang +86
We introduce Gemini Embedding 2, a native multimodal embedding model that allows embedding video, audio, image, and text modalities in a unified representation space. We leverage t…
On Relation-Specific Neurons in Large Language Models
Yihong Liu, Runsheng Chen, Lea Hirlimann +6
In large language models (LLMs), certain \emph{neurons} can store distinct pieces of knowledge learned during pretraining. While factual knowledge typically appears as a combinatio…
LM-CPPF: Paraphrasing-Guided Data Augmentation for Contrastive Prompt-Based Few-Shot Fine-Tuning
Amirhossein Abaskohi, Sascha Rothe, Yadollah Yaghoobzadeh
In recent years, there has been significant progress in developing pre-trained language models for NLP. However, these models often struggle when fine-tuned on small datasets. To a…
Zero-Shot Retrieval with Search Agents and Hybrid Environments
Michelle Chen Huebscher, Christian Buck, Massimiliano Ciaramita +1
Learning to search is the task of building artificial agents that learn to autonomously use a search box to find information. So far, it has been shown that current language models…
A Simple Recipe for Multilingual Grammatical Error Correction
Sascha Rothe, Jonathan Mallinson, Eric Malmi +2
This paper presents a simple recipe to train state-of-the-art multilingual Grammatical Error Correction (GEC) models. We achieve this by first proposing a language-agnostic method…
Focus Attention: Promoting Faithfulness and Diversity in Summarization
Rahul Aralikatte, Shashi Narayan, Joshua Maynez +2
Professional summaries are written with document-level information, such as the theme of the document, in mind. This is in contrast with most seq2seq decoders which simultaneously…