activity
20202022
most citedBetter than Average: Paired Evaluation of NLP Systems

14 citations · 37 across the 7 of their papers we have counts for

collaborators

7 papers

cs.LG20224 cited

Bi-CLKT: Bi-Graph Contrastive Learning based Knowledge Tracing

Xiangyu Song, Jianxin Li, Qi Lei +3

The goal of Knowledge Tracing (KT) is to estimate how well students have mastered a concept based on their historical learning of related exercises. The benefit of knowledge tracin…

cs.CL2021

Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors

Marvin Kaster, Wei Zhao, Steffen Eger

Evaluation metrics are a key ingredient for progress of text generation systems. In recent years, several BERT-based evaluation metrics have been proposed (including BERTScore, Mov…

cs.CL202114 cited

Better than Average: Paired Evaluation of NLP Systems

Maxime Peyrard, Wei Zhao, Steffen Eger +1

Evaluation in NLP is usually done by comparing the scores of competing systems independently averaged over a common set of test instances. In this work, we question the use of aver…

cs.CL20211 cited

The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Results

Marina Fomicheva, Piyawat Lertvittayakumjorn, Wei Zhao +2

In this paper, we introduce the Eval4NLP-2021shared task on explainable quality estimation. Given a source-translation pair, this shared task requires not only to provide a sentenc…

cs.LG2021

Graph Routing between Capsules

Yang Li, Wei Zhao, Erik Cambria +2

Routing methods in capsule networks often learn a hierarchical relationship for capsules in successive layers, but the intra-relation between capsules in the same layer is less stu…

cs.CL20204 cited

On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation

Wei Zhao, Goran Glavaš, Maxime Peyrard +3

Evaluation of cross-lingual encoders is usually performed either via zero-shot cross-lingual transfer in supervised downstream tasks or via unsupervised cross-lingual textual simil…