56 citations · 298 across the 31 of their papers we have counts for
36 papers
PetalView: Fine-grained Location and Orientation Extraction of Street-view Images via Cross-view Local Search with Supplementary Materials
Wenmiao Hu, Yichen Zhang, Yuxuan Liang +5
Satellite-based street-view information extraction by cross-view matching refers to a task that extracts the location and orientation information of a given street-view image query…
Prototypical Cross-domain Knowledge Transfer for Cervical Dysplasia Visual Inspection
Yichen Zhang, Yifang Yin, Ying Zhang +3
Early detection of dysplasia of the cervix is critical for cervical cancer treatment. However, automatic cervical dysplasia diagnosis via visual inspection, which is more appropria…
SOGDet: Semantic-Occupancy Guided Multi-view 3D Object Detection
Qiu Zhou, Jinming Cao, Hanchao Leng +3
In the field of autonomous driving, accurate and comprehensive perception of the 3D environment is crucial. Bird's Eye View (BEV) based methods have emerged as a promising solution…
In Defense of Clip-based Video Relation Detection
Meng Wei, Long Chen, Wei Ji +2
Video Visual Relation Detection (VidVRD) aims to detect visual relationship triplets in videos using spatial bounding boxes and temporal boundaries. Existing VidVRD methods can be…
Beyond Geo-localization: Fine-grained Orientation of Street-view Images by Cross-view Matching with Satellite Imagery with Supplementary Materials
Wenmiao Hu, Yichen Zhang, Yuxuan Liang +6
Street-view imagery provides us with novel experiences to explore different places remotely. Carefully calibrated street-view images (e.g. Google Street View) can be used for diffe…
Panoptic Scene Graph Generation with Semantics-Prototype Learning
Li Li, Wei Ji, Yiming Wu +4
Panoptic Scene Graph Generation (PSG) parses objects and predicts their relationships (predicate) to connect human language and visual scenes. However, different language preferenc…
LaDe: The First Comprehensive Last-mile Delivery Dataset from Industry
Lixia Wu, Haomin Wen, Haoyuan Hu +10
Real-world last-mile delivery datasets are crucial for research in logistics, supply chain management, and spatio-temporal data mining. Despite a plethora of algorithms developed t…
LargeST: A Benchmark Dataset for Large-Scale Traffic Forecasting
Xu Liu, Yutong Xia, Yuxuan Liang +7
Road traffic forecasting plays a critical role in smart city initiatives and has experienced significant advancements thanks to the power of deep learning in capturing non-linear p…
Graph Neural Processes for Spatio-Temporal Extrapolation
Junfeng Hu, Yuxuan Liang, Zhencheng Fan +3
We study the task of spatio-temporal extrapolation that generates data at target locations from surrounding contexts in a graph. This task is crucial as sensors that collect data a…
A real-time blind quality-of-experience assessment metric for HTTP adaptive streaming
Chunyi Li, May Lim, Abdelhak Bentaleb +1
In today's Internet, HTTP Adaptive Streaming (HAS) is the mainstream standard for video streaming, which switches the bitrate of the video content based on an Adaptive BitRate (ABR…
Do We Really Need Graph Neural Networks for Traffic Forecasting?
Xu Liu, Yuxuan Liang, Chao Huang +4
Spatio-temporal graph neural networks (STGNN) have become the most popular solution to traffic forecasting. While successful, they rely on the message passing scheme of GNNs to est…
DiffSTG: Probabilistic Spatio-Temporal Graph Forecasting with Denoising Diffusion Models
Haomin Wen, Youfang Lin, Yutong Xia +4
Spatio-temporal graph neural networks (STGNN) have emerged as the dominant model for spatio-temporal graph (STG) forecasting. Despite their success, they fail to model intrinsic un…
Analyzing Modality Robustness in Multimodal Sentiment Analysis
Devamanyu Hazarika, Yingting Li, Bo Cheng +3
Building robust multimodal models are crucial for achieving reliable deployment in the wild. Despite its importance, less attention has been paid to identifying and improving the r…
So Different Yet So Alike! Constrained Unsupervised Text Style Transfer
Abhinav Ramesh Kashyap, Devamanyu Hazarika, Min-Yen Kan +2
Automatic transfer of text between domains has become popular in recent times. One of its aims is to preserve the semantic content of text being translated from source to target do…
Mix-up Self-Supervised Learning for Contrast-agnostic Applications
Yichen Zhang, Yifang Yin, Ying Zhang +1
Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented vi…
DualFormer: Local-Global Stratified Transformer for Efficient Video Recognition
Yuxuan Liang, Pan Zhou, Roger Zimmermann +1
While transformers have shown great potential on video recognition with their strong capability of capturing long-range dependencies, they often suffer high computational costs ind…
Decoupling Long- and Short-Term Patterns in Spatiotemporal Inference
Junfeng Hu, Yuxuan Liang, Zhencheng Fan +3
Sensors are the key to environmental monitoring, which impart benefits to smart cities in many aspects, such as providing real-time air quality information to assist human decision…
When Do Contrastive Learning Signals Help Spatio-Temporal Graph Forecasting?
Xu Liu, Yuxuan Liang, Chao Huang +3
Deep learning models are modern tools for spatio-temporal graph (STG) forecasting. Though successful, we argue that data scarcity is a key factor limiting their recent improvements…
Recovering the Unbiased Scene Graphs from the Biased Ones
Meng-Jiun Chiou, Henghui Ding, Hanshu Yan +3
Given input images, scene graph generation (SGG) aims to produce comprehensive, graphical representations describing visual relationships among salient objects. Recently, more effo…
ST-HOI: A Spatial-Temporal Baseline for Human-Object Interaction Detection in Videos
Meng-Jiun Chiou, Chun-Yu Liao, Li-Wei Wang +2
Detecting human-object interactions (HOI) is an important step toward a comprehensive visual understanding of machines. While detecting non-temporal HOIs (e.g., sitting on a chair)…
Towards Modelling Coherence in Spoken Discourse
Rajaswa Patil, Yaman Kumar Singla, Rajiv Ratn Shah +2
While there has been significant progress towards modelling coherence in written discourse, the work in modelling spoken discourse coherence has been quite limited. Unlike the cohe…
LIFI: Towards Linguistically Informed Frame Interpolation
Aradhya Neeraj Mathur, Devansh Batra, Yaman Kumar +2
In this work, we explore a new problem of frame interpolation for speech videos. Such content today forms the major form of online communication. We try to solve this problem by us…
Domain Divergences: a Survey and Empirical Analysis
Abhinav Ramesh Kashyap, Devamanyu Hazarika, Min-Yen Kan +1
Domain divergence plays a significant role in estimating the performance of a model in new domains. While there is a significant literature on divergence measures, researchers find…
Multimodal Research in Vision and Language: A Review of Current and Emerging Trends
Shagun Uppal, Sarthak Bhagat, Devamanyu Hazarika +4
Deep Learning and its applications have cascaded impactful research and development with a diverse range of modalities present in the real-world data. More recently, this has enhan…