52 citations · 83 across the 12 of their papers we have counts for
Showing 2019Show all
3 papers · 1 filter
math.NA2019★ 6 cited
Comparison of Accuracy and Scalability of Gauss-Newton and Alternating Least Squares for CP Decomposition
Navjot Singh, Linjian Ma, Hongru Yang +1
Alternating least squares is the most widely used algorithm for CP tensor decomposition. However, alternating least squares may exhibit slow or no convergence, especially when high…
cs.CL2019★ 52 cited
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT
Sheng Shen, Zhen Dong, Jiayu Ye +5
Transformer based architectures have become de-facto models used for a range of Natural Language Processing tasks. In particular, the BERT based models achieved significant accurac…
cs.LG2019★ 3 cited
Inefficiency of K-FAC for Large Batch Size Training
Linjian Ma, Gabe Montague, Jiayu Ye +4
In stochastic optimization, using large batch sizes during training can leverage parallel resources to produce faster wall-clock training times per training epoch. However, for bot…