most citedLeveraging Speech for Gesture Detection in Multimodal Communication

1 citations · 2 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CL2024

MBBQ: A Dataset for Cross-Lingual Comparison of Stereotypes in Generative LLMs

Vera Neplenbroek, Arianna Bisazza, Raquel Fernández

Generative large language models (LLMs) have been shown to exhibit harmful biases and stereotypes. While safety fine-tuning typically takes place in English, if at all, these model…

cs.CV20241 cited

Leveraging Speech for Gesture Detection in Multimodal Communication

Esam Ghaleb, Ilya Burenko, Marlou Rasenberg +7

Gestures are inherent to human interaction and often complement speech in face-to-face communication, forming a multimodal communication system. An important task in gesture analys…

cs.CL20241 cited

Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions

Alberto Testoni, Raquel Fernández

Clarification questions are an essential dialogue tool to signal misunderstanding, ambiguities, and under-specification in language use. While humans are able to resolve uncertaint…

cs.CL2024

Describing Images : Quantifying and Predicting the Variation in Human Signals during Visuo-Linguistic Processes

Ece Takmaz, Sandro Pezzelle, Raquel Fernández

There is an intricate relation between the properties of an image and how humans behave while describing the image. This behavior shows ample variation, as manifested in human sign…

cs.CL2019

Evaluating the Representational Hub of Language and Vision Models

Ravi Shekhar, Ece Takmaz, Raquel Fernández +1

The multimodal models used in the emerging field at the intersection of computational linguistics and computer vision implement the bottom-up processing of the `Hub and Spoke' arch…