activity
20212023
most citedMeasuring Reliability of Large Language Models through Semantic Consistency

9 citations · 23 across the 12 of their papers we have counts for

collaborators
Showing cs.CLShow all

9 papers · 1 filter

cs.CL2023★ 2 cited

Self-Consistency of Large Language Models under Ambiguity

Henning Bartsch, Ole Jorgensen, Domenic Rosati +2

Large language models (LLMs) that do not give consistent answers across contexts are problematic when used for tasks with expectations of consistency, e.g., question-answering, exp…

cs.CL2023★ 4 cited

Semantic Consistency for Assuring Reliability of Large Language Models

Harsh Raj, Vipul Gupta, Domenic Rosati +1

Large Language Models (LLMs) exhibit remarkable fluency and competence across various natural language tasks. However, recent research has highlighted their sensitivity to variatio…

cs.CL2023

Background Knowledge Grounding for Readable, Relevant, and Factual Biomedical Lay Summaries

Domenic Rosati

Communication of scientific findings to the public is important for keeping non-experts informed of developments such as life-saving medical treatments. However, generating readabl…

cs.CL2023

Mixture of Soft Prompts for Controllable Data Generation

Derek Chen, Celine Lee, Yunan Lu +2

Large language models (LLMs) effectively generate fluent text when the target output follows natural language patterns. However, structured prediction tasks confine the output form…

cs.CL2022★ 9 cited

Measuring Reliability of Large Language Models through Semantic Consistency

Harsh Raj, Domenic Rosati, Subhabrata Majumdar

While large pretrained language models (PLMs) demonstrate incredible fluency and performance on many natural language tasks, recent work has shown that well-performing PLMs are ver…

cs.CL2022

Using contradictions improves question answering systems

Étienne Fortier-Dubois, Domenic Rosati

This work examines the use of contradiction in natural language inference (NLI) for question answering (QA). Typically, NLI systems help answer questions by determining if a potent…

cs.CL2022

Moving beyond word lists: towards abstractive topic labels for human-like topics of scientific documents

Domenic Rosati

Topic models represent groups of documents as a list of words (the topic labels). This work asks whether an alternative approach to topic labeling can be developed that is closer t…

cs.CL2022★ 6 cited

SynSciPass: detecting appropriate uses of scientific text generation

Domenic Rosati

Approaches to machine generated text detection tend to focus on binary classification of human versus machine written text. In the scientific domain where publishers might use thes…

cs.CL2022

Learning to pronounce as measuring cross-lingual joint orthography-phonology complexity

Domenic Rosati

Machine learning models allow us to compare languages by showing how hard a task in each language might be to learn and perform well on. Following this line of investigation, we ex…