20 citations · 60 across the 25 of their papers we have counts for
25 papers
Self-Supervised Audio-and-Text Pre-training with Extremely Low-Resource Parallel Data
Yu Kang, Tianqiao Liu, Hang Li +2
Multimodal pre-training for audio-and-text has recently been proved to be effective and has significantly improved the performance of many downstream speech understanding tasks. Ho…
CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations
Hang Li, Yu Kang, Tianqiao Liu +2
Existing audio-language task-specific predictive approaches focus on building complicated late-fusion mechanisms. However, these models are facing challenges of overfitting with li…
Temporal-aware Language Representation Learning From Crowdsourced Labels
Yang Hao, Xiao Zhai, Wenbiao Ding +1
Learning effective language representations from crowdsourced labels is crucial for many real-world machine learning tasks. A challenging aspect of this problem is that the quality…
Automatic Task Requirements Writing Evaluation via Machine Reading Comprehension
Shiting Xu, Guowei Xu, Peilei Jia +3
Task requirements (TRs) writing is an important question type in Key English Test and Preliminary English Test. A TR writing question may include multiple requirements and a high-q…
A Multimodal Machine Learning Framework for Teacher Vocal Delivery Evaluation
Hang Li, Yu Kang, Yang Hao +3
The quality of vocal delivery is one of the key indicators for evaluating teacher enthusiasm, which has been widely accepted to be connected to the overall course qualities. Howeve…
An Educational System for Personalized Teacher Recommendation in K-12 Online Classrooms
Jiahao Chen, Hang Li, Wenbiao Ding +1
In this paper, we propose a simple yet effective solution to build practical teacher recommender systems for online one-on-one classes. Our system consists of (1) a pseudo matching…
Solving ESL Sentence Completion Questions via Pre-trained Neural Language Models
Qiongqiong Liu, Tianqiao Liu, Jiafu Zhao +6
Sentence completion (SC) questions present a sentence with one or more blanks that need to be filled in, three to five possible words or phrases as options. SC questions are widely…
Multi-Task Learning based Online Dialogic Instruction Detection with Pre-trained Language Models
Yang Hao, Hang Li, Wenbiao Ding +4
In this work, we study computational approaches to detect online dialogic instructions, which are widely used to help students understand learning materials, and build effective st…
Robust Learning for Text Classification with Multi-source Noise Simulation and Hard Example Mining
Guowei Xu, Wenbiao Ding, Weiping Fu +2
Many real-world applications involve the use of Optical Character Recognition (OCR) engines to transform handwritten images into transcripts on which downstream Natural Language Pr…
Towards the Memorization Effect of Neural Networks in Adversarial Training
Han Xu, Xiaorui Liu, Wentao Wang +5
Recent studies suggest that ``memorization'' is one important factor for overparameterized deep neural networks (DNNs) to achieve optimal performance. Specifically, the perfectly f…
Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence
Jian Guan, Xiaoxi Mao, Changjie Fan +3
Generating long and coherent text is an important but challenging task, particularly for open-ended language generation tasks such as story generation. Despite the success in model…
OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics
Jian Guan, Zhexin Zhang, Zhuoer Feng +5
Automatic metrics are essential for developing natural language generation (NLG) models, particularly for open-ended language generation tasks such as story generation. However, ex…
Learning Fine-Grained Cross Modality Excitement for Speech Emotion Recognition
Hang Li, Wenbiao Ding, Zhongqin Wu +1
Speech emotion recognition is a challenging task because the emotion expression is complex, multimodal and fine-grained. In this paper, we propose a novel multimodal deep learning…
Mathematical Word Problem Generation from Commonsense Knowledge Graph and Equations
Tianqiao Liu, Qiang Fang, Wenbiao Ding +3
There is an increasing interest in the use of mathematical word problem (MWP) generation in educational assessment. Different from standard natural question generation, MWP generat…
Representation Learning from Limited Educational Data with Crowdsourced Labels
Wentao Wang, Guowei Xu, Wenbiao Ding +4
Representation learning has been proven to play an important role in the unprecedented success of machine learning models in numerous tasks, such as machine translation, face recog…
Automatic Dialogic Instruction Detection for K-12 Online One-on-one Classes
Shiting Xu, Wenbiao Ding, Zitao Liu
Online one-on-one class is created for highly interactive and immersive learning experience. It demands a large number of qualified online instructors. In this work, we develop six…
Neural Multi-Task Learning for Teacher Question Detection in Online Classrooms
Gale Yan Huang, Jiahao Chen, Haochen Liu +6
Asking questions is one of the most crucial pedagogical techniques used by teachers in class. It not only offers open-ended discussions between teachers and students to exchange id…
Siamese Neural Networks for Class Activity Detection
Hang Li, Zhiwei Wang, Jiliang Tang +2
Classroom activity detection (CAD) aims at accurately recognizing speaker roles (either teacher or student) in classrooms. A CAD solution helps teachers get instant feedback on the…
Identifying At-Risk K-12 Students in Multimodal Online Environments: A Machine Learning Approach
Hang Li, Wenbiao Ding, Zitao Liu
With the rapid emergence of K-12 online learning platforms, a new era of education has been opened up. It is crucial to have a dropout warning framework to preemptively identify K-…
NeuCrowd: Neural Sampling Network for Representation Learning with Crowdsourced Labels
Yang Hao, Wenbiao Ding, Zitao Liu
Representation learning approaches require a massive amount of discriminative training data, which is unavailable in many scenarios, such as healthcare, smart city, education, etc.…
Multimodal Learning For Classroom Activity Detection
Hang Li, Yu Kang, Wenbiao Ding +4
Classroom activity detection (CAD) focuses on accurately classifying whether the teacher or student is speaking and recording both the length of individual utterances during a clas…
Automatic Short Answer Grading via Multiway Attention Networks
Tiaoqiao Liu, Wenbiao Ding, Zhiwei Wang +3
Automatic short answer grading (ASAG), which autonomously score student answers according to reference answers, provides a cost-effective and consistent approach to teaching profes…
A Multimodal Alerting System for Online Class Quality Assurance
Jiahao Chen, Hang Li, Wenxin Wang +3
Online 1 on 1 class is created for more personalized learning experience. It demands a large number of teaching resources, which are scarce in China. To alleviate this problem, we…
Dolphin: A Spoken Language Proficiency Assessment System for Elementary Education
Wenbiao Ding, Guowei Xu, Tianqiao Liu +7
Spoken language proficiency is critically important for children's growth and personal development. Due to the limited and imbalanced educational resources in China, elementary stu…