3 papers
cs.HC2024
LLM Confidence Evaluation Measures in Zero-Shot CSS Classification
David Farr, Iain Cruickshank, Nico Manzonelli +3
Assessing classification confidence is critical for leveraging large language models (LLMs) in automated labeling tasks, especially in the sensitive domains presented by Computatio…
cs.LG2024
LLM Chain Ensembles for Scalable and Accurate Data Annotation
David Farr, Nico Manzonelli, Iain Cruickshank +2
The ability of large language models (LLMs) to perform zero-shot classification makes them viable solutions for data annotation in rapidly evolving domains where quality labeled da…
cs.LG2024
RED-CT: A Systems Design Methodology for Using LLM-labeled Data to Train and Deploy Edge Classifiers for Computational Social Science
David Farr, Nico Manzonelli, Iain Cruickshank +1
Large language models (LLMs) have enhanced our ability to rapidly analyze and classify unstructured natural language data. However, concerns regarding cost, network limitations, an…