54 citations · 222 across the 22 of their papers we have counts for
22 papers
Self-Supervised Learning for WiFi CSI-Based Human Activity Recognition: A Systematic Study
Ke Xu, Jiangtao Wang, Hongyuan Zhu +1
Recently, with the advancement of the Internet of Things (IoT), WiFi CSI-based HAR has gained increasing attention from academic and industry communities. By integrating the deep l…
Multi-view Vision-Prompt Fusion Network: Can 2D Pre-trained Model Boost 3D Point Cloud Data-scarce Learning?
Haoyang Peng, Baopu Li, Bo Zhang +3
Point cloud based 3D deep model has wide applications in many applications such as autonomous driving, house robot, and so on. Inspired by the recent prompt learning in natural lan…
What Makes for Effective Few-shot Point Cloud Classification?
Chuangguan Ye, Hongyuan Zhu, Yongbin Liao +3
Due to the emergence of powerful computing resources and large-scale annotated datasets, deep learning has seen wide applications in our daily life. However, most current methods r…
A Closer Look at Few-Shot 3D Point Cloud Classification
Chuangguan Ye, Hongyuan Zhu, Bo Zhang +1
In recent years, research on few-shot learning (FSL) has been fast-growing in the 2D image domain due to the less requirement for labeled training data and greater generalization f…
End-to-End 3D Dense Captioning with Vote2Cap-DETR
Sijin Chen, Hongyuan Zhu, Xin Chen +3
3D dense captioning aims to generate multiple captions localized with their associated object regions. Existing methods follow a sophisticated ``detect-then-describe'' pipeline equ…
Semantic Role Aware Correlation Transformer for Text to Video Retrieval
Burak Satar, Hongyuan Zhu, Xavier Bresson +1
With the emergence of social media, voluminous video clips are uploaded every day, and retrieving the most relevant visual content with a language query becomes critical. Most appr…
RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video Retrieval
Burak Satar, Hongyuan Zhu, Hanwang Zhang +1
Seas of videos are uploaded daily with the popularity of social channels; thus, retrieving the most related video contents with user textual queries plays a more crucial role. Most…
Exploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022
Burak Satar, Hongyuan Zhu, Hanwang Zhang +1
In this report, we present our approach for EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022. We first parse sentences into semantic roles corresponding to verbs and nouns…
OPQ: Compressing Deep Neural Networks with One-shot Pruning-Quantization
Peng Hu, Xi Peng, Hongyuan Zhu +2
As Deep Neural Networks (DNNs) usually are overparameterized and have millions of weight parameters, it is challenging to deploy these large DNN models on resource-constrained hard…
CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flow
Xiuchao Sui, Shaohua Li, Xue Geng +5
Optical flow estimation aims to find the 2D motion field by identifying corresponding pixels between two images. Despite the tremendous progress of deep learning-based optical flow…
Point Cloud Instance Segmentation with Semi-supervised Bounding-Box Mining
Yongbin Liao, Hongyuan Zhu, Yanggang Zhang +3
Point cloud instance segmentation has achieved huge progress with the emergence of deep learning. However, these methods are usually data-hungry with expensive and time-consuming d…
Efficient Robotic Task Generalization Using Deep Model Fusion Reinforcement Learning
Tianying Wang, Hao Zhang, Wei Qi Toh +5
Learning-based methods have been used to pro-gram robotic tasks in recent years. However, extensive training is usually required not only for the initial task learning but also for…
6D Pose Estimation with Correlation Fusion
Yi Cheng, Hongyuan Zhu, Ying Sun +6
6D object pose estimation is widely applied in robotic tasks such as grasping and manipulation. Prior methods using RGB-only images are vulnerable to heavy occlusion and poor illum…
Clustering with Similarity Preserving
Zhao Kang, Honghui Xu, Boyu Wang +2
Graph-based clustering has shown promising performance in many tasks. A key step of graph-based approach is the similarity graph construction. In general, learning graph in kernel…
Scene Text Synthesis for Efficient and Effective Deep Network Training
Changgong Zhang, Fangneng Zhan, Hongyuan Zhu +1
A large amount of annotated training images is critical for training accurate and robust deep network models but the collection of a large amount of annotated training images is of…
Spatial Fusion GAN for Image Synthesis
Fangneng Zhan, Hongyuan Zhu, Shijian Lu
Recent advances in generative adversarial networks (GANs) have shown great potentials in realistic image synthesis whereas most existing works address synthesis realism in either a…
Holistic Multi-modal Memory Network for Movie Question Answering
Anran Wang, Anh Tuan Luu, Chuan-Sheng Foo +3
Answering questions according to multi-modal context is a challenging problem as it requires a deep integration of different data sources. Existing approaches only employ partial i…
XAI Beyond Classification: Interpretable Neural Clustering
Xi Peng, Yunnan Li, Ivor W. Tsang +3
In this paper, we study two challenging problems in explainable AI (XAI) and data clustering. The first is how to directly design a neural network with inherent interpretability, r…
Truly Multi-modal YouTube-8M Video Classification with Video, Audio, and Text
Zhe Wang, Kingsley Kuan, Mathieu Ravaut +13
The YouTube-8M video classification challenge requires teams to classify 0.7 million videos into one or more of 4,716 classes. In this Kaggle competition, we placed in the top 3% o…
YoTube: Searching Action Proposal via Recurrent and Static Regression Networks
Hongyuan Zhu, Romain Vial, Shijian Lu +2
In this paper, we present YoTube-a novel network fusion framework for searching action proposals in untrimmed videos, where each action proposal corresponds to a spatialtemporal vi…
Diagnosing State-Of-The-Art Object Proposal Methods
Hongyuan Zhu, Shijian Lu, Jianfei Cai +1
Object proposal has become a popular paradigm to replace exhaustive sliding window search in current top-performing methods in PASCAL VOC and ImageNet. Recently, Hosang et al. cond…
Beyond Pixels: A Comprehensive Survey from Bottom-up to Semantic Image Segmentation and Cosegmentation
Hongyuan Zhu, Fanman Meng, Jianfei Cai +1
Image segmentation refers to the process to divide an image into nonoverlapping meaningful regions according to human perception, which has become a classic topic since the early a…