4 papers
Can Crowdsourcing Survive the LLM Era? A Community Survey on Human Data Collection
Aswathy Velutharambath, Neele Falk, Sofie Labat +2
The widespread use of Large Language Models (LLMs) as writing tools challenges the validity of crowdsourced data, as crowdworkers may outsource tasks to models. To better understan…
What Are LLMs Doing to Scientific Communication? Measuring Changes in Writing Practices and Reading Experience
Filip MiletiÄ, Neele Falk
Has the style of scientific communication changed due to the growing use of large language models in the writing process? We address this question in the domain of Natural Language…
Annotator-Centric Active Learning for Subjective NLP Tasks
Michiel van der Meer, Neele Falk, Pradeep K. Murukannaiah +1
Active Learning (AL) addresses the high costs of collecting human annotations by strategically annotating the most informative samples. However, for subjective NLP tasks, incorpora…
Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMs
Tanise Ceron, Neele Falk, Ana BariÄ +2
Due to the widespread use of large language models (LLMs), we need to understand whether they embed a specific "worldview" and what these views reflect. Recent studies report that,…