24 citations · 35 across the 6 of their papers we have counts for
6 papers
Masked Structural Growth for 2x Faster Language Model Pre-training
Yiqun Yao, Zheng Zhang, Jing Li +1
Accelerating large language model pre-training is a critical issue in present research. In this paper, we focus on speeding up pre-training by progressively growing from a small Tr…
nanoLM: an Affordable LLM Pre-training Benchmark via Accurate Loss Prediction across Scales
Yiqun Yao, Siqi fan, Xiusheng Huang +10
As language models scale up, it becomes increasingly expensive to verify research ideas because conclusions on small models do not trivially transfer to large ones. A possible solu…
MUSER: MUltimodal Stress Detection using Emotion Recognition as an Auxiliary Task
Yiqun Yao, Michalis Papakostas, Mihai Burzo +2
The capability to automatically detect human stress can benefit artificial intelligent agents involved in affective computing and human-computer interaction. Stress and emotion are…
Concept Learning through Deep Reinforcement Learning with Memory-Augmented Neural Networks
Jing Shi, Jiaming Xu, Yiqun Yao +1
Deep neural networks have shown superior performance in many regimes to remember familiar patterns with large amounts of data. However, the standard supervised deep learning paradi…
Cascaded Mutual Modulation for Visual Reasoning
Yiqun Yao, Jiaming Xu, Feng Wang +1
Visual reasoning is a special visual question answering problem that is multi-step and compositional by nature, and also requires intensive text-vision interactions. We propose CMM…
Hierarchical Memory Networks for Answer Selection on Unknown Words
Jiaming Xu, Jing Shi, Yiqun Yao +2
Recently, end-to-end memory networks have shown promising results on Question Answering task, which encode the past facts into an explicit memory and perform reasoning ability by m…