30 citations · 88 across the 20 of their papers we have counts for
21 papers
Progressive: A Teacher-Student Progressive Co-Evolving Knowledge Distillation Method for Substantial Model Compression
Tiancong Cheng, Ying Zhang, Zhiwen Yu +2
Knowledge distillation (KD) is a widely utilized technique for transferring knowledge from a large model (the teacher) to a smaller model (the student). Owing to its flexibility an…
OpenAVS: Training-Free Open-Vocabulary Audio Visual Segmentation with Foundational Models
Shengkai Chen, Yifang Yin, Jinming Cao +3
Audio-visual segmentation aims to separate sounding objects from videos by predicting pixel-level masks based on audio signals. Existing methods primarily concentrate on closed-set…
TAIL: Text-Audio Incremental Learning
Yingfei Sun, Xu Gu, Wei Ji +3
Many studies combine text and audio to capture multi-modal information but they overlook the model's generalization ability on new datasets. Introducing new datasets may affect the…
Manifold-Aware Local Feature Modeling for Semi-Supervised Medical Image Segmentation
Sicheng Shen, Jinming Cao, Yifang Yin +1
Achieving precise medical image segmentation is vital for effective treatment planning and accurate disease diagnosis. Traditional fully-supervised deep learning methods, though hi…
PetalView: Fine-grained Location and Orientation Extraction of Street-view Images via Cross-view Local Search with Supplementary Materials
Wenmiao Hu, Yichen Zhang, Yuxuan Liang +5
Satellite-based street-view information extraction by cross-view matching refers to a task that extracts the location and orientation information of a given street-view image query…
Prompt-Based Spatio-Temporal Graph Transfer Learning
Junfeng Hu, Xu Liu, Zhencheng Fan +4
Spatio-temporal graph neural networks have proven efficacy in capturing complex dependencies for urban computing tasks such as forecasting and kriging. Yet, their performance is co…
ShapeMoiré: Channel-Wise Shape-Guided Network for Image Demoiréing
Jinming Cao, Sicheng Shen, Qiu Zhou +3
Photographing optoelectronic displays often introduces unwanted moiré patterns due to analog signal interference between the pixel grids of the display and the camera sensor arrays…
DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Clues
Kun Pan, Yin Yifang, Yao Wei +6
The malicious use and widespread dissemination of deepfake pose a significant crisis of trust. Current deepfake detection models can generally recognize forgery images by training…
Prototypical Cross-domain Knowledge Transfer for Cervical Dysplasia Visual Inspection
Yichen Zhang, Yifang Yin, Ying Zhang +3
Early detection of dysplasia of the cervix is critical for cervical cancer treatment. However, automatic cervical dysplasia diagnosis via visual inspection, which is more appropria…
SOGDet: Semantic-Occupancy Guided Multi-view 3D Object Detection
Qiu Zhou, Jinming Cao, Hanchao Leng +3
In the field of autonomous driving, accurate and comprehensive perception of the 3D environment is crucial. Bird's Eye View (BEV) based methods have emerged as a promising solution…
Beyond Geo-localization: Fine-grained Orientation of Street-view Images by Cross-view Matching with Satellite Imagery with Supplementary Materials
Wenmiao Hu, Yichen Zhang, Yuxuan Liang +6
Street-view imagery provides us with novel experiences to explore different places remotely. Carefully calibrated street-view images (e.g. Google Street View) can be used for diffe…
Emotionally Enhanced Talking Face Generation
Sahil Goyal, Shagun Uppal, Sarthak Bhagat +3
Several works have developed end-to-end pipelines for generating lip-synced talking faces with various real-world applications, such as teaching and language translation in videos.…
Mix-up Self-Supervised Learning for Contrast-agnostic Applications
Yichen Zhang, Yifang Yin, Ying Zhang +1
Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented vi…
Motion Prediction via Joint Dependency Modeling in Phase Space
Pengxiang Su, Zhenguang Liu, Shuang Wu +3
Motion prediction is a classic problem in computer vision, which aims at forecasting future motion given the observed pose sequence. Various deep learning models have been proposed…
Decoupling Long- and Short-Term Patterns in Spatiotemporal Inference
Junfeng Hu, Yuxuan Liang, Zhencheng Fan +3
Sensors are the key to environmental monitoring, which impart benefits to smart cities in many aspects, such as providing real-time air quality information to assist human decision…
Zero-Shot Multi-View Indoor Localization via Graph Location Networks
Meng-Jiun Chiou, Zhenguang Liu, Yifang Yin +2
Indoor localization is a fundamental problem in location-based applications. Current approaches to this problem typically rely on Radio Frequency technology, which requires not onl…
"Notic My Speech" -- Blending Speech Patterns With Multimedia
Dhruva Sahrawat, Yaman Kumar, Shashwat Aggarwal +3
Speech as a natural signal is composed of three parts - visemes (visual part of speech), phonemes (spoken part of speech), and language (the imposed structure). However, video as a…
COBRA: Contrastive Bi-Modal Representation Algorithm
Vishaal Udandarao, Abhishek Maiti, Deepak Srivatsav +3
There are a wide range of applications that involve multi-modal data, such as cross-modal retrieval, visual question-answering, and image captioning. Such applications are primaril…
Lipper: Synthesizing Thy Speech using Multi-View Lipreading
Yaman Kumar, Rohit Jain, Khwaja Mohd. Salik +3
Lipreading has a lot of potential applications such as in the domain of surveillance and video conferencing. Despite this, most of the work in building lipreading systems has been…
Harnessing GANs for Zero-shot Learning of New Classes in Visual Speech Recognition
Yaman Kumar, Dhruva Sahrawat, Shubham Maheshwari +5
Visual Speech Recognition (VSR) is the process of recognizing or interpreting speech by watching the lip movements of the speaker. Recent machine learning based approaches model VS…
A Multimodal Approach to Predict Social Media Popularity
Mayank Meghawat, Satyendra Yadav, Debanjan Mahata +3
Multiple modalities represent different aspects by which information is conveyed by a data source. Modern day social media platforms are one of the primary sources of multimodal da…