16 citations · 18 across the 3 of their papers we have counts for
5 papers
"High-Quality" Data for Early-Stage Instruction Tuning: An Empirical Study of Data Quality Metrics
Vladimir Necula, David Gvadzabia, Sofia Serrano
"Data quality" is widely invoked in instruction tuning, but the term is often underspecified. We study it as an operational property by asking which simple example-level metrics, d…
Language Models: A Guide for the Perplexed
Sofia Serrano, Zander Brumbaugh, Noah A. Smith
Given the growing importance of AI literacy, we decided to write this tutorial to help narrow the gap between the discourse among those who study language models -- the core techno…
Stubborn Lexical Bias in Data and Models
Sofia Serrano, Jesse Dodge, Noah A. Smith
In NLP, recent work has seen increased focus on spurious correlations between various features and labels in training data, and how these influence model behavior. However, the pre…
All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text
Elizabeth Clark, Tal August, Sofia Serrano +3
Human evaluations are typically considered the gold standard in natural language generation, but as models' fluency improves, how well can evaluators detect and judge machine-gener…
Is Attention Interpretable?
Sofia Serrano, Noah A. Smith
Attention mechanisms have recently boosted performance on a range of NLP tasks. Because attention layers explicitly weight input components' representations, it is also often assum…