4 papers
Reasoner Outperforms: Generative Stance Detection with Rationalization for Social Media
Jiaqing Yuan, Ruijie Xi, Munindar P. Singh
Stance detection is crucial for fostering a human-centric Web by analyzing user-generated content to identify biases and harmful narratives that undermine trust. With the developme…
Right vs. Right: Can LLMs Make Tough Choices?
Jiaqing Yuan, Pradeep K. Murukannaiah, Munindar P. Singh
An ethical dilemma describes a choice between two "right" options involving conflicting moral values. We present a comprehensive evaluation of how LLMs navigate ethical dilemmas. S…
A Benchmark for Cross-Domain Argumentative Stance Classification on Social Media
Jiaqing Yuan, Ruijie Xi, Munindar P. Singh
Argumentative stance classification plays a key role in identifying authors' viewpoints on specific topics. However, generating diverse pairs of argumentative sentences across vari…
Towards a Holistic Evaluation of LLMs on Factual Knowledge Recall
Jiaqing Yuan, Lin Pan, Chung-Wei Hang +5
Large language models (LLMs) have shown remarkable performance on a variety of NLP tasks, and are being rapidly adopted in a wide range of use cases. It is therefore of vital impor…