How to Evaluate Automatic Speech Recognition: Comparing Different Performance and Bias Measures

Tanvina Patel, Wiebke Hutiri, Aaron Yi Ding +1

There is increasingly more evidence that automatic speech recognition (ASR) systems are biased against different speakers and speaker groups, e.g., due to gender, age, or accent. R…