3 citations · 10 across the 12 of their papers we have counts for
13 papers
ProtoVQA: An Adaptable Prototypical Framework for Explainable Fine-Grained Visual Question Answering
Xingjian Diao, Weiyi Wu, Keyi Kong +5
Visual Question Answering (VQA) is increasingly used in diverse applications ranging from general visual reasoning to safety-critical domains such as medical imaging and autonomous…
Learning Sparsity for Effective and Efficient Music Performance Question Answering
Xingjian Diao, Tianzhen Yang, Chunhui Zhang +3
Music performances, characterized by dense and continuous audio as well as seamless audio-visual integration, present unique challenges for multimodal scene understanding and reaso…
Music Audio-Visual Question Answering Requires Specialized Multimodal Designs
Wenhao You, Xingjian Diao, Wenjun Huang +9
While recent Multimodal Large Language Models exhibit impressive capabilities for general multimodal tasks, specialized domains like music necessitate tailored approaches. Music Au…
Learning Musical Representations for Music Performance Question Answering
Xingjian Diao, Chunhui Zhang, Tingxuan Wu +4
Music performances are representative scenarios for audio-visual modeling. Unlike common scenarios with sparse audio, music performances continuously involve dense audio signals th…
Temporal Working Memory: Query-Guided Segment Refinement for Enhanced Multimodal Understanding
Xingjian Diao, Chunhui Zhang, Weiyi Wu +5
Multimodal foundation models (MFMs) have demonstrated significant success in tasks such as visual captioning, question answering, and image-text retrieval. However, these models fa…
GluMarker: A Novel Predictive Modeling of Glycemic Control Through Digital Biomarkers
Ziyi Zhou, Ming Cheng, Xingjian Diao +2
The escalating prevalence of diabetes globally underscores the need for diabetes management. Recent research highlights the growing focus on digital biomarkers in diabetes manageme…
Toward Short-Term Glucose Prediction Solely Based on CGM Time Series
Ming Cheng, Xingjian Diao, Ziyi Zhou +3
The global diabetes epidemic highlights the importance of maintaining good glycemic control. Glucose prediction is a fundamental aspect of diabetes management, facilitating real-ti…
CrossGP: Cross-Day Glucose Prediction Excluding Physiological Information
Ziyi Zhou, Ming Cheng, Yanjun Cui +2
The increasing number of diabetic patients is a serious issue in society today, which has significant negative impacts on people's health and the country's financial expenditures.…
Efflex: Efficient and Flexible Pipeline for Spatio-Temporal Trajectory Graph Modeling and Representation Learning
Ming Cheng, Ziyi Zhou, Bowen Zhang +7
In the landscape of spatio-temporal data analytics, effective trajectory representation learning is paramount. To bridge the gap of learning accurate representations with efficient…
VeTraSS: Vehicle Trajectory Similarity Search Through Graph Modeling and Representation Learning
Ming Cheng, Bowen Zhang, Ziyu Wang +4
Trajectory similarity search plays an essential role in autonomous driving, as it enables vehicles to analyze the information and characteristics of different trajectories to make…
SAIC: Integration of Speech Anonymization and Identity Classification
Ming Cheng, Xingjian Diao, Shitong Cheng +1
Speech anonymization and de-identification have garnered significant attention recently, especially in the healthcare area including telehealth consultations, patient voiceprint ma…
FT2TF: First-Person Statement Text-To-Talking Face Generation
Xingjian Diao, Ming Cheng, Wayner Barrios +1
Talking face generation has gained immense popularity in the computer vision community, with various applications including AR, VR, teleconferencing, digital assistants, and avatar…
AV-MaskEnhancer: Enhancing Video Representations through Audio-Visual Masked Autoencoder
Xingjian Diao, Ming Cheng, Shitong Cheng
Learning high-quality video representation has shown significant applications in computer vision and remains challenging. Previous work based on mask autoencoders such as ImageMAE…