3 citations · 3 across the 3 of their papers we have counts for
4 papers
Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics
Jiannan Xiang, Huayang Li, Yahui Liu +4
Current practices in metric evaluation focus on one single dataset, e.g., Newstest dataset in each year's WMT Metrics Shared Task. However, in this paper, we qualitatively and quan…
Visualizing the Relationship Between Encoded Linguistic Information and Task Performance
Jiannan Xiang, Huayang Li, Defu Lian +3
Probing is popular to analyze whether linguistic information can be captured by a well-trained deep neural model, but it is hard to answer how the change of the encoded linguistic…
Assessing Dialogue Systems with Distribution Distances
Jiannan Xiang, Yahui Liu, Deng Cai +3
An important aspect of developing dialogue systems is how to evaluate and compare the performance of different systems. Existing automatic evaluation metrics are based on turn-leve…
Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation
Jiannan Xiang, Xin Eric Wang, William Yang Wang
Vision-and-Language Navigation (VLN) is a natural language grounding task where an agent learns to follow language instructions and navigate to specified destinations in real-world…