most citedGenerative Representational Instruction Tuning

15 citations · 23 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CL2026

DRACULA: Hunting for the Actions Users Want Deep Research Agents to Execute

Nishant Balepur, Malachi Hamada, Varsha Kishore +9

Scientific Deep Research (DR) agents answer user queries by synthesizing research papers into multi-section reports. User feedback can improve their utility, but existing protocols…

cs.CL2024

LMUnit: Fine-grained Evaluation with Natural Language Unit Tests

Jon Saad-Falcon, Rajan Vivek, William Berrios +6

As language models become integral to critical workflows, assessing their behavior remains a fundamental challenge -- human evaluation is costly and noisy, while automated metrics…

cs.LG2024★ 1 cited

Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment

Karel D'Oosterlinck, Winnie Xu, Chris Develder +5

Large Language Models (LLMs) are often aligned using contrastive alignment objectives and preference pair datasets. The interaction between model, paired data, and objective makes…

cs.CL2024★ 7 cited

OLMoE: Open Mixture-of-Experts Language Models

Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld +21

We introduce OLMoE, a fully open, state-of-the-art language model leveraging sparse Mixture-of-Experts (MoE). OLMoE-1B-7B has 7 billion (B) parameters but uses only 1B per input to…

cs.CL2024★ 15 cited

Generative Representational Instruction Tuning

Niklas Muennighoff, Hongjin Su, Liang Wang +5

All text-based language problems can be reduced to either generation or embedding. Current models only perform well at one or the other. We introduce generative representational in…