4 papers
Is Large Language Model Performance on Reasoning Tasks Impacted by Different Ways Questions Are Asked?
Seok Hwan Song, Mohna Chakraborty, Qi Li +1
Large Language Models (LLMs) have been evaluated using diverse question types, e.g., multiple-choice, true/false, and short/long answers. This study answers an unexplored question…
Modeling Data Diversity for Joint Instance and Verbalizer Selection in Cold-Start Scenarios
Mohna Chakraborty, Adithya Kulkarni, Qi Li
Prompt-based methods leverage the knowledge of pre-trained language models (PLMs) trained with a masked language modeling (MLM) objective; however, these methods are sensitive to t…
Empirical Analysis for Unsupervised Universal Dependency Parse Tree Aggregation
Adithya Kulkarni, Oliver Eulenstein, Qi Li
Dependency parsing is an essential task in NLP, and the quality of dependency parsers is crucial for many downstream tasks. Parsers' quality often varies depending on the domain an…
An Empirical Study of Using ChatGPT for Fact Verification Task
Mohna Chakraborty, Adithya Kulkarni, Qi Li
ChatGPT has recently emerged as a powerful tool for performing diverse NLP tasks. However, ChatGPT has been criticized for generating nonfactual responses, raising concerns about i…