72 citations · 116 across the 8 of their papers we have counts for
3 papers · 1 filter
Robust Infidelity: When Faithfulness Measures on Masked Language Models Are Misleading
Evan Crothers, Herna Viktor, Nathalie Japkowicz
A common approach to quantifying neural text classifier interpretability is to calculate faithfulness metrics based on iteratively masking salient input tokens and measuring change…
Measuring Improvement of F-Scores in Detection of Self-Admitted Technical Debt
William Aiken, Paul K. Mvula, Paula Branco +3
Artificial Intelligence and Machine Learning have witnessed rapid, significant improvements in Natural Language Processing (NLP) tasks. Utilizing Deep Learning, researchers have ta…
In BLOOM: Creativity and Affinity in Artificial Lyrics and Art
Evan Crothers, Herna Viktor, Nathalie Japkowicz
We apply a large multilingual language model (BLOOM-176B) in open-ended generation of Chinese song lyrics, and evaluate the resulting lyrics for coherence and creativity using huma…