1 citations · 1 across the 11 of their papers we have counts for
4 papers · 1 filter
Proactive Conversational Assistant for a Procedural Manual Task based on Audio and IMU
Rehana Mahfuz, Yinyi Guo, Erik Visser +1
Real-time conversational assistants for procedural manual tasks often depend on video input, which can be computationally expensive and compromise user privacy. For the first time,…
Resource-Efficient Reference-Free Evaluation of Audio Captions
Rehana Mahfuz, Yinyi Guo, Erik Visser
To establish the trustworthiness of systems that automatically generate text captions for audio, images and video, existing reference-free metrics rely on large pretrained models w…
Detecting False Alarms and Misses in Audio Captions
Rehana Mahfuz, Yinyi Guo, Arvind Krishna Sridhar +1
Metrics to evaluate audio captions simply provide a score without much explanation regarding what may be wrong in case the score is low. Manual human intervention is needed to find…
Improving Audio Captioning Using Semantic Similarity Metrics
Rehana Mahfuz, Yinyi Guo, Erik Visser
Audio captioning quality metrics which are typically borrowed from the machine translation and image captioning areas measure the degree of overlap between predicted tokens and gol…