activity
20142026
most citedDistilling Task-Specific Knowledge from BERT into Simple Neural Networks

335 citations · 1.7k across the 86 of their papers we have counts for

collaborators
Showing 2015 · cs.CLShow all

5 papers · 2 filters

cs.CL2015★ 47 cited

Natural Language Inference by Tree-Based Convolution and Heuristic Matching

Lili Mou, Rui Men, Ge Li +4

In this paper, we propose the TBCNN-pair model to recognize entailment and contradiction between two sentences. In our model, a tree-based convolutional neural network (TBCNN) capt…

cs.CL2015★ 8 cited

A Comparative Study on Regularization Strategies for Embedding-based Neural Networks

Hao Peng, Lili Mou, Ge Li +3

This paper aims to compare different regularization strategies to address a common phenomenon, severe overfitting, in embedding-based neural networks for NLP. We chose two widely s…

cs.CL2015★ 111 cited

Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Path

Xu Yan, Lili Mou, Ge Li +3

Relation classification is an important research arena in the field of natural language processing (NLP). In this paper, we present SDP-LSTM, a novel neural network to classify the…

cs.CL2015★ 64 cited

Discriminative Neural Sentence Modeling by Tree-Based Convolution

Lili Mou, Hao Peng, Ge Li +3

This paper proposes a tree-based convolutional neural network (TBCNN) for discriminative sentence modeling. Our models leverage either constituency trees or dependency trees of sen…

cs.CL2015★ 15 cited

Distilling Word Embeddings: An Encoding Approach

Lili Mou, Ran Jia, Yan Xu +3

Distilling knowledge from a well-trained cumbersome network to a small one has recently become a new research topic, as lightweight neural networks with high performance are partic…