10 citations · 19 across the 10 of their papers we have counts for
10 papers
Self-Supervised Audio-and-Text Pre-training with Extremely Low-Resource Parallel Data
Yu Kang, Tianqiao Liu, Hang Li +2
Multimodal pre-training for audio-and-text has recently been proved to be effective and has significantly improved the performance of many downstream speech understanding tasks. Ho…
CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations
Hang Li, Yu Kang, Tianqiao Liu +2
Existing audio-language task-specific predictive approaches focus on building complicated late-fusion mechanisms. However, these models are facing challenges of overfitting with li…
A Multimodal Machine Learning Framework for Teacher Vocal Delivery Evaluation
Hang Li, Yu Kang, Yang Hao +3
The quality of vocal delivery is one of the key indicators for evaluating teacher enthusiasm, which has been widely accepted to be connected to the overall course qualities. Howeve…
An Educational System for Personalized Teacher Recommendation in K-12 Online Classrooms
Jiahao Chen, Hang Li, Wenbiao Ding +1
In this paper, we propose a simple yet effective solution to build practical teacher recommender systems for online one-on-one classes. Our system consists of (1) a pseudo matching…
Multi-Task Learning based Online Dialogic Instruction Detection with Pre-trained Language Models
Yang Hao, Hang Li, Wenbiao Ding +4
In this work, we study computational approaches to detect online dialogic instructions, which are widely used to help students understand learning materials, and build effective st…
Learning Fine-Grained Cross Modality Excitement for Speech Emotion Recognition
Hang Li, Wenbiao Ding, Zhongqin Wu +1
Speech emotion recognition is a challenging task because the emotion expression is complex, multimodal and fine-grained. In this paper, we propose a novel multimodal deep learning…
Siamese Neural Networks for Class Activity Detection
Hang Li, Zhiwei Wang, Jiliang Tang +2
Classroom activity detection (CAD) aims at accurately recognizing speaker roles (either teacher or student) in classrooms. A CAD solution helps teachers get instant feedback on the…
Identifying At-Risk K-12 Students in Multimodal Online Environments: A Machine Learning Approach
Hang Li, Wenbiao Ding, Zitao Liu
With the rapid emergence of K-12 online learning platforms, a new era of education has been opened up. It is crucial to have a dropout warning framework to preemptively identify K-…
Multimodal Learning For Classroom Activity Detection
Hang Li, Yu Kang, Wenbiao Ding +4
Classroom activity detection (CAD) focuses on accurately classifying whether the teacher or student is speaking and recording both the length of individual utterances during a clas…
A Multimodal Alerting System for Online Class Quality Assurance
Jiahao Chen, Hang Li, Wenxin Wang +3
Online 1 on 1 class is created for more personalized learning experience. It demands a large number of teaching resources, which are scarce in China. To alleviate this problem, we…