15 citations · 15 across the 1 of their papers we have counts for
3 papers
cs.CL2019
On conducting better validation studies of automatic metrics in natural language generation evaluation
Johnny Tian-Zheng Wei
Natural language generation (NLG) has received increasing attention, which has highlighted evaluation as a central methodological concern. Since human evaluations for these systems…
cs.CL2019★ 15 cited
Better Automatic Evaluation of Open-Domain Dialogue Systems with Contextualized Embeddings
Sarik Ghazarian, Johnny Tian-Zheng Wei, Aram Galstyan +1
Despite advances in open-domain dialogue systems, automatic evaluation of such systems is still a challenging problem. Traditional reference-based metrics such as BLEU are ineffect…
cs.CL2018
Evaluating Syntactic Properties of Seq2seq Output with a Broad Coverage HPSG: A Case Study on Machine Translation
Johnny Tian-Zheng Wei, Khiem Pham, Brian Dillon +1
Sequence to sequence (seq2seq) models are often employed in settings where the target output is natural language. However, the syntactic properties of the language generated from t…