188 citations · 620 across the 44 of their papers we have counts for
23 papers · 1 filter
Parasitic Co-Denoising: Unlocking 3D Human Motion Generation in a Frozen Video Diffusion Model
Yunjiao Zhou, Junlang Qian, Lihua Xie +1
Despite never being supervised on explicit 3D motion, large-scale text-to-video diffusion models synthesize realistic human motion in their generated videos. We ask whether this im…
Rethinking Fixed Temporal Grids: Frequency-Disentangled Motion Generation
Yunjiao Zhou, Junlang Qian, Gen Li +3
Most human motion generation methods encode motion as tokens on a uniform temporal grid, where every token spans the same fixed time window. Human motion, however, is temporally he…
M4Human: A Large-Scale Multimodal mmWave Radar Benchmark for Human Mesh Reconstruction
Junqiao Fan, Yunjiao Zhou, Yizhuo Yang +6
Human mesh reconstruction (HMR) provides direct insights into body-environment interaction, which enables various immersive applications. While existing large-scale HMR datasets re…
mmPred: Radar-based Human Motion Prediction in the Dark
Junqiao Fan, Haocong Rao, Jiarui Zhang +2
Existing Human Motion Prediction (HMP) methods based on RGB-D cameras are sensitive to lighting conditions and raise privacy concerns, limiting their real-world applications such a…
Zero-Shot Open-Vocabulary Human Motion Grounding with Test-Time Training
Yunjiao Zhou, Xinyan Chen, Junlang Qian +2
Understanding complex human activities demands the ability to decompose motion into fine-grained, semantic-aligned sub-actions. This motion grounding process is crucial for behavio…
Diffusion Model is a Good Pose Estimator from 3D RF-Vision
Junqiao Fan, Jianfei Yang, Yuecong Xu +1
Human pose estimation (HPE) from Radio Frequency vision (RF-vision) performs human sensing using RF signals that penetrate obstacles without revealing privacy (e.g., facial informa…
Interactive Test-Time Adaptation with Reliable Spatial-Temporal Voxels for Multi-Modal Segmentation
Haozhi Cao, Yuecong Xu, Pengyu Yin +4
Multi-modal test-time adaptation (MM-TTA) adapts models to an unlabeled target domain by leveraging the complementary multi-modal inputs in an online manner. While previous MM-TTA…
PSS-BA: LiDAR Bundle Adjustment with Progressive Spatial Smoothing
Jianping Li, Thien-Minh Nguyen, Shenghai Yuan +1
Accurate and consistent construction of point clouds from LiDAR scanning data is fundamental for 3D modeling applications. Current solutions, such as multiview point cloud registra…
T3DNet: Compressing Point Cloud Models for Lightweight 3D Recognition
Zhiyuan Yang, Yunjiao Zhou, Lihua Xie +1
3D point cloud has been widely used in many mobile application scenarios, including autonomous driving and 3D sensing on mobile devices. However, existing 3D point cloud models ten…
MaskFi: Unsupervised Learning of WiFi and Vision Representations for Multimodal Human Activity Recognition
Jianfei Yang, Shijie Tang, Yuecong Xu +2
Human activity recognition (HAR) has been playing an increasingly important role in various domains such as healthcare, security monitoring, and metaverse gaming. Though numerous H…
TENT: Connect Language Models with IoT Sensors for Zero-Shot Activity Recognition
Yunjiao Zhou, Jianfei Yang, Han Zou +1
Recent achievements in language models have showcased their extraordinary capabilities in bridging visual information with semantic language understanding. This leads us to a novel…
MoPA: Multi-Modal Prior Aided Domain Adaptation for 3D Semantic Segmentation
Haozhi Cao, Yuecong Xu, Jianfei Yang +3
Multi-modal unsupervised domain adaptation (MM-UDA) for 3D semantic segmentation is a practical solution to embed semantic understanding in autonomous systems without expensive poi…
AdaPose: Towards Cross-Site Device-Free Human Pose Estimation with Commodity WiFi
Yunjiao Zhou, Jianfei Yang, He Huang +1
WiFi-based pose estimation is a technology with great potential for the development of smart homes and metaverse avatar generation. However, current WiFi-based pose estimation meth…
Can We Evaluate Domain Adaptation Models Without Target-Domain Labels?
Jianfei Yang, Hanjie Qian, Yuecong Xu +2
Unsupervised domain adaptation (UDA) involves adapting a model trained on a label-rich source domain to an unlabeled target domain. However, in real-world scenarios, the absence of…
Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentation
Haozhi Cao, Yuecong Xu, Jianfei Yang +3
Continual Test-Time Adaptation (CTTA) generalizes conventional Test-Time Adaptation (TTA) by assuming that the target domain is dynamic over time rather than stationary. In this pa…
Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Survey
Yuecong Xu, Haozhi Cao, Zhenghua Chen +3
Video analysis tasks such as action recognition have received increasing research interest with growing applications in fields such as smart healthcare, thanks to the introduction…
AirFi: Empowering WiFi-based Passive Human Gesture Recognition to Unseen Environment via Domain Generalization
Dazhuo Wang, Jianfei Yang, Wei Cui +2
WiFi-based smart human sensing technology enabled by Channel State Information (CSI) has received great attention in recent years. However, CSI-based sensing systems suffer from pe…
GaitFi: Robust Device-Free Human Identification via WiFi and Vision Multimodal Learning
Lang Deng, Jianfei Yang, Shenghai Yuan +3
As an important biomarker for human identification, human gait can be collected at a distance by passive sensors without subject cooperation, which plays an essential role in crime…
MetaFi: Device-Free Pose Estimation via Commodity WiFi for Metaverse Avatar Simulation
Jianfei Yang, Yunjiao Zhou, He Huang +2
Avatar refers to a representative of a physical user in the virtual world that can engage in different activities and interact with other objects in metaverse. Simulating the avata…
Leveraging Endo- and Exo-Temporal Regularization for Black-box Video Domain Adaptation
Yuecong Xu, Jianfei Yang, Haozhi Cao +4
To enable video models to be applied seamlessly across video tasks in different environments, various Video Unsupervised Domain Adaptation (VUDA) methods have been proposed to impr…
Computer Vision for Road Imaging and Pothole Detection: A State-of-the-Art Review of Systems and Algorithms
Nachuan Ma, Jiahe Fan, Wenshuo Wang +4
Computer vision algorithms have been prevalently utilized for 3-D road imaging and pothole detection for over two decades. Nonetheless, there is a lack of systematic survey article…
Self-Supervised Video Representation Learning by Video Incoherence Detection
Haozhi Cao, Yuecong Xu, Jianfei Yang +4
This paper introduces a novel self-supervised method that leverages incoherence detection for video representation learning. It roots from the observation that visual systems of hu…
Aligning Correlation Information for Domain Adaptation in Action Recognition
Yuecong Xu, Jianfei Yang, Haozhi Cao +3
Domain adaptation (DA) approaches address domain shift and enable networks to be applied to different scenarios. Although various image DA approaches have been proposed in recent y…