activity
20232025
most citedLarge Language Models are Inconsistent and Biased Evaluators

12 citations · 22 across the 9 of their papers we have counts for

collaborators

9 papers

cs.CL2025

A Platform for Investigating Public Health Content with Efficient Concern Classification

Christopher Li, Rickard Stureborg, Bhuwan Dhingra +1

A recent rise in online content expressing concerns with public health initiatives has contributed to already stalled uptake of preemptive measures globally. Future public health e…

cs.CL2024

MatViX: Multimodal Information Extraction from Visually Rich Articles

Ghazal Khalighinejad, Sharon Scott, Ollie Liu +4

Multimodal information extraction (MIE) is crucial for scientific literature, where valuable data is often spread across text, figures, and tables. In materials science, extracting…

cs.CL2024★ 1 cited

Your Large Language Models Are Leaving Fingerprints

Hope McGovern, Rickard Stureborg, Yoshi Suhara +1

It has been shown that finetuned transformers and other supervised detectors effectively distinguish between human and machine-generated text in some situations arXiv:2305.13242, b…

cs.CL2024★ 12 cited

Large Language Models are Inconsistent and Biased Evaluators

Rickard Stureborg, Dimitris Alikaniotis, Yoshi Suhara

The zero-shot capability of Large Language Models (LLMs) has enabled highly flexible, reference-free metrics for various tasks, making LLM evaluators common tools in NLP. However,…

cs.CL2024

Tailoring Vaccine Messaging with Common-Ground Opinions

Rickard Stureborg, Sanxing Chen, Ruoyu Xie +6

One way to personalize chatbot interactions is by establishing common ground with the intended reader. A domain where establishing mutual understanding could be particularly impact…

cs.CL2024

Hierarchical Multi-Label Classification of Online Vaccine Concerns

Chloe Qinyu Zhu, Rickard Stureborg, Bhuwan Dhingra

Vaccine concerns are an ever-evolving target, and can shift quickly as seen during the COVID-19 pandemic. Identifying longitudinal trends in vaccine concerns and misinformation mig…

cs.CL2023

Do Not Harm Protected Groups in Debiasing Language Representation Models

Chloe Qinyu Zhu, Rickard Stureborg, Brandon Fain

Language Representation Models (LRMs) trained with real-world data may capture and exacerbate undesired bias and cause unfair treatment of people in various demographic groups. Sev…

cs.CL2023

Learning the Legibility of Visual Text Perturbations

Dev Seth, Rickard Stureborg, Danish Pruthi +1

Many adversarial attacks in NLP perturb inputs to produce visually similar strings ('ergo' 'rgo') which are legible to humans but degrade model performance. Althou…

cs.HC2023★ 9 cited

Interface Design for Crowdsourcing Hierarchical Multi-Label Text Annotations

Rickard Stureborg, Bhuwan Dhingra, Jun Yang

Human data labeling is an important and expensive task at the heart of supervised learning systems. Hierarchies help humans understand and organize concepts. We ask whether and how…