32 citations · 146 across the 11 of their papers we have counts for
5 papers · 1 filter
Neural Network Training Techniques Regularize Optimization Trajectory: An Empirical Study
Cheng Chen, Junjie Yang, Yi Zhou
Modern deep neural network (DNN) trainings utilize various training techniques, e.g., nonlinear activation functions, batch normalization, skip-connections, etc. Despite their effe…
Bilevel Optimization: Convergence Analysis and Enhanced Design
Kaiyi Ji, Junjie Yang, Yingbin Liang
Bilevel optimization has arisen as a powerful tool for many machine learning problems such as meta-learning, hyperparameter optimization, and reinforcement learning. In this paper,…
Multi-span Style Extraction for Generative Reading Comprehension
Junjie Yang, Zhuosheng Zhang, Hai Zhao
Generative machine reading comprehension (MRC) requires a model to generate well-formed answers. For this type of MRC, answer generation method is crucial to the model performance.…
Theoretical Convergence of Multi-Step Model-Agnostic Meta-Learning
Kaiyi Ji, Junjie Yang, Yingbin Liang
As a popular meta-learning approach, the model-agnostic meta-learning (MAML) algorithm has been widely used due to its simplicity and effectiveness. However, the convergence of the…
Retrospective Reader for Machine Reading Comprehension
Zhuosheng Zhang, Junjie Yang, Hai Zhao
Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answe…