303 citations · 563 across the 47 of their papers we have counts for
17 papers · 1 filter
Improved Speech Pre-Training with Supervision-Enhanced Acoustic Unit
Pengcheng Li, Genshun Wan, Fenglin Ding +4
Speech pre-training has shown great success in learning useful and general latent representations from large-scale unlabeled data. Based on a well-designed self-supervised learning…
Progressive Multi-Scale Self-Supervised Learning for Speech Recognition
Genshun Wan, Tan Liu, Hang Chen +3
Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the m…
Improved Self-Supervised Multilingual Speech Representation Learning Combined with Auxiliary Language Information
Fenglin Ding, Genshun Wan, Pengcheng Li +2
Multilingual end-to-end models have shown great improvement over monolingual systems. With the development of pre-training methods on speech, self-supervised multilingual speech re…
Self-Supervised Audio-Visual Speech Representations Learning By Multimodal Self-Distillation
Jing-Xuan Zhang, Genshun Wan, Zhen-Hua Ling +3
In this work, we present a novel method, named AV2vec, for learning audio-visual speech representations by multimodal self-distillation. AV2vec has a student and a teacher module,…
Neural Implicit k-Space for Binning-free Non-Cartesian Cardiac MR Imaging
Wenqi Huang, Hongwei Li, Jiazhen Pan +3
In this work, we propose a novel image reconstruction framework that directly learns a neural implicit representation in k-space for ECG-triggered non-Cartesian Cardiac Magnetic Re…
Siamese Object Tracking for Vision-Based UAM Approaching with Pairwise Scale-Channel Attention
Guangze Zheng, Changhong Fu, Junjie Ye +3
Although the manipulating of the unmanned aerial manipulator (UAM) has been widely studied, vision-based UAM approaching, which is crucial to the subsequent manipulating, generally…
Tuning anomalous Floquet topological bands with ultracold atoms
Jin-Yi Zhang, Chang-Rui Yi, Long Zhang +7
The Floquet engineering opens the way to create new topological states without counterparts in static systems. Here, we report the experimental realization and characterization of…
Hierarchical Temporal Transformer for 3D Hand Pose Estimation and Action Recognition from Egocentric RGB Videos
Yilin Wen, Hao Pan, Lei Yang +3
Understanding dynamic hand motions and actions from egocentric RGB videos is a fundamental yet challenging task due to self-occlusion and ambiguity. To address occlusion and ambigu…
Monocular Camera-based Complex Obstacle Avoidance via Efficient Deep Reinforcement Learning
Jianchuan Ding, Lingping Gao, Wenxi Liu +5
Deep reinforcement learning has achieved great success in laser-based collision avoidance works because the laser can sense accurate depth information without too much redundant da…
ModLaNets: Learning Generalisable Dynamics via Modularity and Physical Inductive Bias
Yupu Lu, Shijie Lin, Guanqi Chen +1
Deep learning models are able to approximate one specific dynamical system but struggle at learning generalisable dynamics, where dynamical systems obey the same laws of physics bu…
Precision Determination of the Neutral Weak Form Factor of Ca
D. Adhikari, H. Albataineh, D. Androic +99
We report a precise measurement of the parity-violating asymmetry in the elastic scattering of longitudinally polarized electrons from . We measure $A_{…
Is Lip Region-of-Interest Sufficient for Lipreading?
Jing-Xuan Zhang, Gen-Shun Wan, Jia Pan
Lip region-of-interest (ROI) is conventionally used for visual input in the lipreading task. Few works have adopted the entire face as visual input because lip-excluded parts of th…
Towards Understanding Why Mask-Reconstruction Pretraining Helps in Downstream Tasks
Jiachun Pan, Pan Zhou, Shuicheng Yan
For unsupervised pretraining, mask-reconstruction pretraining (MRP) approaches, e.g. MAE and data2vec, randomly mask input patches and then reconstruct the pixels or semantic featu…
Adaptive Network Combination for Single-Image Reflection Removal: A Domain Generalization Perspective
Ming Liu, Jianan Pan, Zifei Yan +2
Recently, multiple synthetic and real-world datasets have been built to facilitate the training of deep single image reflection removal (SIRR) models. Meanwhile, diverse testing se…
End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Maps
Ke Guo, Wenxi Liu, Jia Pan
In this paper, we aim to forecast a future trajectory distribution of a moving agent in the real world, given the social scene images and historical trajectories. Yet, it is a chal…
Relationformer: A Unified Framework for Image-to-Graph Generation
Suprosanna Shit, Rajat Koner, Bastian Wittmann +8
A comprehensive representation of an image requires understanding objects and their mutual relationship, especially in image-to-graph generation, e.g., road network extraction, blo…
Visual-Tactile Sensing for Real-time Liquid Volume Estimation in Grasping
Fan Zhu, Ruixing Jia, Lei Yang +4
We propose a deep visuo-tactile model for realtime estimation of the liquid inside a deformable container in a proprioceptive way.We fuse two sensory modalities, i.e., the raw visu…