activity
20192025
most citedHow Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources

39 citations · 163 across the 23 of their papers we have counts for

collaborators
Showing 2023Show all

6 papers · 1 filter

cs.CL2023★ 8 cited

Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2

Hamish Ivison, Yizhong Wang, Valentina Pyatkin +8

Since the release of TÜLU [Wang et al., 2023b], open resources for instruction tuning have developed quickly, from better base models to new finetuning techniques. We test and inco…

cs.CL2023★ 3 cited

Language Models Hallucinate, but May Excel at Fact Verification

Jian Guan, Jesse Dodge, David Wadden +2

Recent progress in natural language processing (NLP) owes much to remarkable advances in large language models (LLMs). Nevertheless, LLMs frequently "hallucinate," resulting in non…

cs.IR2023★ 3 cited

When do Generative Query and Document Expansions Fail? A Comprehensive Study Across Methods, Retrievers, and Datasets

Orion Weller, Kyle Lo, David Wadden +4

Using large language models (LMs) for query or document expansion can improve generalization in information retrieval. However, it is unknown whether these techniques are universal…

cs.CL2023★ 1 cited

Estimating the Causal Effect of Early ArXiving on Paper Acceptance

Yanai Elazar, Jiayao Zhang, David Wadden +2

What is the effect of releasing a preprint of a paper before it is submitted for peer review? No randomized controlled trial has been conducted, so we turn to observational data to…

cs.CL2023★ 39 cited

How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources

Yizhong Wang, Hamish Ivison, Pradeep Dasigi +8

In this work we explore recent advances in instruction-tuning language models on a range of open instruction-following datasets. Despite recent claims that open models can be on pa…

cs.CL2023★ 6 cited

Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction

Ashish Sharma, Kevin Rushton, Inna Wanyin Lin +5

A proven therapeutic technique to overcome negative thoughts is to replace them with a more hopeful "reframed thought." Although therapy can help people practice and learn this Cog…