activity
20202023
most citedStructured Multi-modal Feature Embedding and Alignment for Image-Sentence Retrieval

49 citations · 158 across the 25 of their papers we have counts for

collaborators
Showing 2021Show all

15 papers · 1 filter

cs.CV2021

Orthogonal Jacobian Regularization for Unsupervised Disentanglement in Image Generation

Yuxiang Wei, Yupeng Shi, Xiao Liu +4

Unsupervised disentanglement learning is a crucial issue for understanding and exploiting deep generative models. Recently, SeFa tries to find latent disentangled directions by per…

cs.CV2021★ 39 cited

UniCon: Unified Context Network for Robust Active Speaker Detection

Yuanhang Zhang, Susan Liang, Shuang Yang +4

We introduce a new efficient framework, the Unified Context Network (UniCon), for robust active speaker detection (ASD). Traditional methods for ASD usually operate on each candida…

cs.CV2021★ 49 cited

Structured Multi-modal Feature Embedding and Alignment for Image-Sentence Retrieval

Xuri Ge, Fuhai Chen, Joemon M. Jose +3

The current state-of-the-art image-sentence retrieval methods implicitly align the visual-textual fragments, like regions in images and words in sentences, and adopt attention modu…

cs.CV2021★ 25 cited

Locality-aware Channel-wise Dropout for Occluded Face Recognition

Mingjie He, Jie Zhang, Shiguang Shan +3

Face recognition remains a challenging task in unconstrained scenarios, especially when faces are partially occluded. To improve the robustness against occlusion, augmenting the tr…

cs.CL2021

Automatic Task Requirements Writing Evaluation via Machine Reading Comprehension

Shiting Xu, Guowei Xu, Peilei Jia +3

Task requirements (TRs) writing is an important question type in Key English Test and Preliminary English Test. A TR writing question may include multiple requirements and a high-q…

cs.SD2021

A Multimodal Machine Learning Framework for Teacher Vocal Delivery Evaluation

Hang Li, Yu Kang, Yang Hao +3

The quality of vocal delivery is one of the key indicators for evaluating teacher enthusiasm, which has been widely accepted to be connected to the overall course qualities. Howeve…

cs.CL2021

Solving ESL Sentence Completion Questions via Pre-trained Neural Language Models

Qiongqiong Liu, Tianqiao Liu, Jiafu Zhao +6

Sentence completion (SC) questions present a sentence with one or more blanks that need to be filled in, three to five possible words or phrases as options. SC questions are widely…

cs.CL2021

Multi-Task Learning based Online Dialogic Instruction Detection with Pre-trained Language Models

Yang Hao, Hang Li, Wenbiao Ding +4

In this work, we study computational approaches to detect online dialogic instructions, which are widely used to help students understand learning materials, and build effective st…

cs.CL2021

Robust Learning for Text Classification with Multi-source Noise Simulation and Hard Example Mining

Guowei Xu, Wenbiao Ding, Weiping Fu +2

Many real-world applications involve the use of Optical Character Recognition (OCR) engines to transform handwritten images into transcripts on which downstream Natural Language Pr…

cs.LG2021★ 1 cited

Towards the Memorization Effect of Neural Networks in Adversarial Training

Han Xu, Xiaorui Liu, Wentao Wang +5

Recent studies suggest that ``memorization'' is one important factor for overparameterized deep neural networks (DNNs) to achieve optimal performance. Specifically, the perfectly f…

cs.SD2021★ 6 cited

Multi-Scale Attention Neural Network for Acoustic Echo Cancellation

Lu Ma, Song Yang, Yaguang Gong +1

Acoustic Echo Cancellation (AEC) plays a key role in speech interaction by suppressing the echo received at microphone introduced by acoustic reverberations from loudspeakers. Sinc…

cs.SD2021

Noise Classification Aided Attention-Based Neural Network for Monaural Speech Enhancement

Lu Ma, Song Yang, Yaguang Gong +1

This paper proposes an noise type classification aided attention-based neural network approach for monaural speech enhancement. The network is constructed based on a previous work…

cs.SD2021★ 1 cited

Multi-Scale Temporal Convolution Network for Classroom Voice Detection

Lu Ma, Xintian Wang, Song Yang +2

Teaching with the cooperation of expert teacher and assistant teacher, which is the so-called "double-teachers classroom", i.e., the course is giving by the expert online and prese…

cs.SD2021★ 9 cited

EchoFilter: End-to-End Neural Network for Acoustic Echo Cancellation

Lu Ma, Song Yang, Yaguang Gong +2

Acoustic Echo Cancellation (AEC) whose aim is to suppress the echo originated from acoustic coupling between loudspeakers and microphones, plays a key role in voice interaction. Li…

cs.CV2021★ 4 cited

Pseudo-ISP: Learning Pseudo In-camera Signal Processing Pipeline from A Color Image Denoiser

Yue Cao, Xiaohe Wu, Shuran Qi +3

The success of deep denoisers on real-world color photographs usually relies on the modeling of sensor noise and in-camera signal processing (ISP) pipeline. Performance drop will i…