37 citations · 174 across the 38 of their papers we have counts for
5 papers · 1 filter
Automatic Evaluation of Generative Models with Instruction Tuning
Shuhaib Mehri, Vered Shwartz
Automatic evaluation of natural language generation has long been an elusive goal in NLP.A recent paradigm fine-tunes pre-trained language models to emulate human judgements for a…
GD-COMET: A Geo-Diverse Commonsense Inference Model
Mehar Bhatia, Vered Shwartz
With the increasing integration of AI into everyday life, it's becoming crucial to design AI systems that serve users from diverse backgrounds by making them culturally aware. In t…
Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models
Natalie Shapira, Mosh Levy, Seyed Hossein Alavi +5
The escalating debate on AI's capabilities warrants developing reliable metrics to assess machine "intelligence". Recently, many anecdotal examples were used to suggest that newer…
From chocolate bunny to chocolate crocodile: Do Language Models Understand Noun Compounds?
Jordan Coil, Vered Shwartz
Noun compound interpretation is the task of expressing a noun compound (e.g. chocolate bunny) in a free-text paraphrase that makes the relationship between the constituent nouns ex…
COMET-M: Reasoning about Multiple Events in Complex Sentences
Sahithya Ravi, Raymond Ng, Vered Shwartz
Understanding the speaker's intended meaning often involves drawing commonsense inferences to reason about what is not stated explicitly. In multi-event sentences, it requires unde…