55 citations · 190 across the 22 of their papers we have counts for
18 papers · 1 filter
Interact with me: Joint Egocentric Forecasting of Intent to Interact, Attitude and Social Actions
Tongfei Bian, Yiming Ma, Mathieu Chollet +2
For efficient human-agent interaction, an agent should proactively recognize their target user and prepare for upcoming interactions. We formulate this challenging problem as the n…
CLIP-EBC: CLIP Can Count Accurately through Enhanced Blockwise Classification
Yiming Ma, Victor Sanchez, Tanaya Guha
We propose CLIP-EBC, the first fully CLIP-based model for accurate crowd density estimation. While the CLIP model has demonstrated remarkable success in addressing recognition task…
Explainable Depression Detection via Head Motion Patterns
Monika Gahalawat, Raul Fernandez Rojas, Tanaya Guha +2
While depression has been studied via multimodal non-verbal behavioural cues, head motion behaviour has not received much attention as a biomarker. This study demonstrates the util…
Robust Multiview Multimodal Driver Monitoring System Using Masked Multi-Head Self-Attention
Yiming Ma, Victor Sanchez, Soodeh Nikan +3
Driver Monitoring Systems (DMSs) are crucial for safe hand-over actions in Level-2+ self-driving vehicles. State-of-the-art DMSs leverage multiple sensors mounted at different loca…
Real-Time Driver Monitoring Systems through Modality and View Analysis
Yiming Ma, Victor Sanchez, Soodeh Nikan +3
Driver distractions are known to be the dominant cause of road accidents. While monitoring systems can detect non-driving-related activities and facilitate reducing the risks, they…
Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection
Kyle Min, Sourya Roy, Subarna Tripathi +2
Active speaker detection (ASD) in videos with multiple speakers is a challenging task as it requires learning effective audiovisual features and spatial-temporal correlations over…
FusionCount: Efficient Crowd Counting via Multiscale Feature Fusion
Yiming Ma, Victor Sanchez, Tanaya Guha
State-of-the-art crowd counting models follow an encoder-decoder approach. Images are first processed by the encoder to extract features. Then, to account for perspective distortio…
Learning Spatial-Temporal Graphs for Active Speaker Detection
Sourya Roy, Kyle Min, Subarna Tripathi +2
We address the problem of active speaker detection through a new framework, called SPELL, that learns long-range multimodal graphs to encode the inter-modal relationship between au…
Multi-Camera Trajectory Forecasting with Trajectory Tensors
Olly Styles, Tanaya Guha, Victor Sanchez
We introduce the problem of multi-camera trajectory forecasting (MCTF), which involves predicting the trajectory of a moving object across a network of cameras. While multi-camera…
In Defense of Scene Graphs for Image Captioning
Kien Nguyen, Subarna Tripathi, Bang Du +2
The mainstream image captioning models rely on Convolutional Neural Network (CNN) image features to generate captions via recurrent models. Recently, image scene graphs have been u…
Compact Graph Architecture for Speech Emotion Recognition
A. Shirian, T. Guha
We propose a deep graph approach to address the task of speech emotion recognition. A compact, efficient and scalable way to represent data is in the form of graphs. Following the…
Dynamic Character Graph via Online Face Clustering for Movie Analysis
Prakhar Kulshreshtha, Tanaya Guha
An effective approach to automated movie content analysis involves building a network (graph) of its characters. Existing work usually builds a static character graph to summarize…
Ensemble Network for Ranking Images Based on Visual Appeal
Sachin Singh, Victor Sanchez, Tanaya Guha
We propose a computational framework for ranking images (group photos in particular) taken at the same event within a short time span. The ranking is expected to correspond with hu…
Multi-Camera Trajectory Forecasting: Pedestrian Trajectory Prediction in a Network of Cameras
Olly Styles, Tanaya Guha, Victor Sanchez +1
We introduce the task of multi-camera trajectory forecasting (MCTF), where the future trajectory of an object is predicted in a network of cameras. Prior works consider forecasting…
Coordinated Joint Multimodal Embeddings for Generalized Audio-Visual Zeroshot Classification and Retrieval of Videos
Kranti Kumar Parida, Neeraj Matiyali, Tanaya Guha +1
We present an audio-visual multimodal approach for the task of zeroshot learning (ZSL) for classification and retrieval of videos. ZSL has been studied extensively in the recent pa…
Multiple Object Forecasting: Predicting Future Object Locations in Diverse Environments
Olly Styles, Tanaya Guha, Victor Sanchez
This paper introduces the problem of multiple object forecasting (MOF), in which the goal is to predict future bounding boxes of tracked objects. In contrast to existing works on o…
Sparse Representation-based Image Quality Assessment
Tanaya Guha, Ehsan Nezhadarya, Rabab K Ward
A successful approach to image quality assessment involves comparing the structural information between a distorted and its reference image. However, extracting structural informat…
Image Similarity Using Sparse Representation and Compression Distance
Tanaya Guha, Rabab K. Ward
A new line of research uses compression methods to measure the similarity between signals. Two signals are considered similar if one can be compressed significantly when the inform…