most citedEfficient Contextual Representation Learning Without Softmax Layer

3 citations · 3 across the 1 of their papers we have counts for

collaborators
Showing cs.CLShow all

2 papers · 1 filter

cs.CL2019★ 3 cited

Efficient Contextual Representation Learning Without Softmax Layer

Liunian Harold Li, Patrick H. Chen, Cho-Jui Hsieh +1

Contextual representation models have achieved great success in improving various downstream tasks. However, these language-model-based encoders are difficult to train due to the l…

cs.CL2018

GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking

Patrick H. Chen, Si Si, Yang Li +2

Model compression is essential for serving large deep neural nets on devices with limited resources or applications that require real-time responses. As a case study, a state-of-th…