10 citations · 23 across the 4 of their papers we have counts for
5 papers
A Survey for Efficient Open Domain Question Answering
Qin Zhang, Shangsi Chen, Dongkuan Xu +4
Open domain question answering (ODQA) is a longstanding task aimed at answering factual questions from a large knowledge corpus without any explicit evidence in natural language pr…
IrEne: Interpretable Energy Prediction for Transformers
Qingqing Cao, Yash Kumar Lal, Harsh Trivedi +2
Existing software-based energy measurements of NLP models are not accurate because they do not consider the complex interactions between energy consumption and model execution. We…
Towards Accurate and Reliable Energy Measurement of NLP Models
Qingqing Cao, Aruna Balasubramanian, Niranjan Balasubramanian
Accurate and reliable measurement of energy consumption is critical for making well-informed design choices when choosing and training large scale NLP models. In this work, we show…
DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering
Qingqing Cao, Harsh Trivedi, Aruna Balasubramanian +1
Transformer-based QA models use input-wide self-attention -- i.e. across both the question and the input passage -- at all layers, causing them to be slow and memory-intensive. It…
MobiRNN: Efficient Recurrent Neural Network Execution on Mobile GPU
Qingqing Cao, Niranjan Balasubramanian, Aruna Balasubramanian
In this paper, we explore optimizations to run Recurrent Neural Network (RNN) models locally on mobile devices. RNN models are widely used for Natural Language Processing, Machine…