23 citations · 49 across the 15 of their papers we have counts for
19 papers
Breakdown of Conversational Involvement: A Joint Multi-Modal Analysis of Conversation Floors and F-formation Detection with Multiple Features
Zonghuan Li, Chirag Raman, Hayley Hung
Interactions happen universally and spontaneously in daily lives. Studying involvement in interactions helps us analyze who can influence who and has a wide potential in applicatio…
GesBench: When and Where Do Multimodal Language Models Perceive Social Meaning?
Zonghuan Li, Hayley Hung, Chirag Raman
Human social perception is incremental: we infer intent before an utterance is complete, revise our interpretation as new cues arrive, and attend to specific facial, gestural, or p…
COSI-Lab: Conference Living Lab for Modeling Multi-Perspective Multimodal Social Intention
Zonghuan Li, Litian Li, Arthur Mercier +17
COSI-Lab presents a multimodal multi-sensor dataset of a real interdisciplinary scientific workshop with 32 academics at an international conference. It captures ecologically valid…
A Synchronized Audio-Visual Multi-View Capture System
Xiangwei Shi, Gara Dorta, Ruud de Jong +2
Multi-view capture systems have been an important tool in research for recording human motion under controlling conditions. Most existing systems are specified around video streams…
Social Processes: Probabilistic Meta-learning for Adaptive Multiparty Interaction Forecasting
Augustinas Jučas, Chirag Raman
Adaptively forecasting human behavior in social settings is an important step toward achieving Artificial General Intelligence. Most existing research in social forecasting has foc…
How Private is Low-Frequency Speech Audio in the Wild? An Analysis of Verbal Intelligibility by Humans and Machines
Ailin Liu, Pepijn Vunderink, Jose Vargas Quiros +2
Low-frequency audio has been proposed as a promising privacy-preserving modality to study social dynamics in real-world settings. To this end, researchers have developed wearable d…
REWIND Dataset: Privacy-preserving Speaking Status Segmentation from Multimodal Body Movement Signals in the Wild
Jose Vargas Quiros, Chirag Raman, Stephanie Tan +3
Recognizing speaking in humans is a central task towards understanding social interactions. Ideally, speaking would be detected from individual voice recordings, as done previously…
Mesh-Tension Driven Expression-Based Wrinkles for Synthetic Faces
Chirag Raman, Charlie Hewitt, Erroll Wood +1
Recent advances in synthesizing realistic faces have shown that synthetic training data can replace real data for various face-related computer vision tasks. A question arises: how…
Perceived Conversation Quality in Spontaneous Interactions
Chirag Raman, Navin Raj Prabhu, Hayley Hung
The quality of daily spontaneous conversations is of importance towards both our well-being as well as the development of interactive social agents. Prior research directly studyin…
Why Did This Model Forecast This Future? Closed-Form Temporal Saliency Towards Causal Explanations of Probabilistic Forecasts
Chirag Raman, Hayley Hung, Marco Loog
Forecasting tasks surrounding the dynamics of low-level human behavior are of significance to multiple research domains. In such settings, methods for explaining specific forecasts…
ConfLab: A Data Collection Concept, Dataset, and Benchmark for Machine Analysis of Free-Standing Social Interactions in the Wild
Chirag Raman, Jose Vargas-Quiros, Stephanie Tan +3
Recording the dynamics of unscripted human interactions in the wild is challenging due to the delicate trade-offs between several factors: participant privacy, ecological validity,…
3D face reconstruction with dense landmarks
Erroll Wood, Tadas Baltrusaitis, Charlie Hewitt +11
Landmarks often play a key role in face analysis, but many aspects of identity or expression cannot be represented by sparse landmarks alone. Thus, in order to reconstruct faces mo…
Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction
Maria Tsfasman, Avinash Saravanan, Dekel Viner +5
How human-like do conversational robots need to look to enable long-term human-robot conversation? One essential aspect of long-term interaction is a human's ability to adapt to th…
Social Processes: Self-Supervised Meta-Learning over Conversational Groups for Forecasting Nonverbal Social Cues
Chirag Raman, Hayley Hung, Marco Loog
Free-standing social conversations constitute a yet underexplored setting for human behavior forecasting. While the task of predicting pedestrian trajectories has received much rec…
Defining and Quantifying Conversation Quality in Spontaneous Interactions
Navin Raj Prabhu, Chirag Raman, Hayley Hung
Social interactions in general are multifaceted and there exists a wide set of factors and events that influence them. In this paper, we quantify social interactions with a holisti…
A Modular Approach for Synchronized Wireless Multimodal Multisensor Data Acquisition in Highly Dynamic Social Settings
Chirag Raman, Stephanie Tan, Hayley Hung
Existing data acquisition literature for human behavior research provides wired solutions, mainly for controlled laboratory setups. In uncontrolled free-standing conversation setti…
Towards automatic estimation of conversation floors within F-formations
Chirag Raman, Hayley Hung
The detection of free-standing conversing groups has received significant attention in recent years. In the absence of a formal definition, most studies operationalize the notion o…
Auto-Grading for 3D Modeling Assignments in MOOCs
Swapneel Mehta, Chirag Raman, Nitin Ayer +1
Bottlenecks such as the latency in correcting assignments and providing a grade for Massive Open Online Courses (MOOCs) could impact the levels of interest among learners. In this…
Multimodal Polynomial Fusion for Detecting Driver Distraction
Yulun Du, Chirag Raman, Alan W Black +2
Distracted driving is deadly, claiming 3,477 lives in the U.S. in 2015 alone. Although there has been a considerable amount of research on modeling the distracted behavior of drive…