4 papers · 1 filter
Translation or Recitation? Calibrating Evaluation Scores for Machine Translation of Extremely Low-Resource Languages
Danlu Chen, Ka Sing He, Jiahe Tian +4
The landscape of extremely low-resource machine translation (MT) is characterized by perplexing variability in reported performance, often making results across different language…
Studying the Soupability of Documents in State Space Models
Yasaman Jafari, Zixian Wang, Leon Bergen +1
We investigate whether hidden states from Structured State Space Models (SSMs) can be merged post hoc to support downstream reasoning. Inspired by model souping, we study document…
Single-Pass Document Scanning for Question Answering
Weili Cao, Jianyou Wang, Youze Zheng +5
Handling extremely large documents for question answering is challenging: chunk-based embedding methods often lose track of important global context, while full-context transformer…
MORL-Prompt: An Empirical Analysis of Multi-Objective Reinforcement Learning for Discrete Prompt Optimization
Yasaman Jafari, Dheeraj Mekala, Rose Yu +1
RL-based techniques can be employed to search for prompts that, when fed into a target language model, maximize a set of user-specified reward functions. However, in many target ap…