6 citations · 23 across the 10 of their papers we have counts for
10 papers
Masked by Consensus: Disentangling Privileged Knowledge in LLM Correctness
Tomer Ashuach, Shai Gretz, Yoav Katz +2
Humans use introspection to evaluate their understanding through private internal states inaccessible to external observers. We investigate whether large language models possess si…
Conversational Prompt Engineering
Liat Ein-Dor, Orith Toledo-Ronen, Artem Spector +5
Prompts are how humans communicate with LLMs. Informative prompts are essential for guiding LLMs to produce the desired output. However, prompt engineering is often tedious and tim…
Stay Tuned: An Empirical Study of the Impact of Hyperparameters on LLM Tuning in Real-World Applications
Alon Halfon, Shai Gretz, Ofir Arviv +6
Fine-tuning Large Language Models (LLMs) is an effective method to enhance their performance on downstream tasks. However, choosing the appropriate setting of tuning hyperparameter…
VIRATrustData: A Trust-Annotated Corpus of Human-Chatbot Conversations About COVID-19 Vaccines
Roni Friedman, João Sedoc, Shai Gretz +5
Public trust in medical information is crucial for successful application of public health policies such as vaccine uptake. This is especially true when the information is offered…
Benchmark Data and Evaluation Framework for Intent Discovery Around COVID-19 Vaccine Hesitancy
Shai Gretz, Assaf Toledo, Roni Friedman +7
The COVID-19 pandemic has made a huge global impact and cost millions of lives. As COVID-19 vaccines were rolled out, they were quickly met with widespread hesitancy. To address th…
The workweek is the best time to start a family -- A Study of GPT-2 Based Claim Generation
Shai Gretz, Yonatan Bilu, Edo Cohen-Karlik +1
Argument generation is a challenging task whose research is timely considering its potential impact on social media and the dissemination of information. Here we suggest a pipeline…
What if we had no Wikipedia? Domain-independent Term Extraction from a Large News Corpus
Yonatan Bilu, Shai Gretz, Edo Cohen +1
One of the most impressive human endeavors of the past two decades is the collection and categorization of human knowledge in the free and accessible format that is Wikipedia. In t…
A Large-scale Dataset for Argument Quality Ranking: Construction and Analysis
Shai Gretz, Roni Friedman, Edo Cohen-Karlik +4
Identifying the quality of free-text arguments has become an important task in the rapidly expanding field of computational argumentation. In this work, we explore the challenging…
Automatic Argument Quality Assessment -- New Datasets and Methods
Assaf Toledo, Shai Gretz, Edo Cohen-Karlik +6
We explore the task of automatic assessment of argument quality. To that end, we actively collected 6.3k arguments, more than a factor of five compared to previously examined data.…
Towards Effective Rebuttal: Listening Comprehension using Corpus-Wide Claim Mining
Tamar Lavee, Matan Orbach, Lili Kotlerman +8
Engaging in a live debate requires, among other things, the ability to effectively rebut arguments claimed by your opponent. In particular, this requires identifying these argument…