XNLI: Explaining and Diagnosing NLI-based Visual Data Analysis
arXiv:2301.10385 · doi:10.1109/TVCG.2023.3240003
Abstract
Natural language interfaces (NLIs) enable users to flexibly specify analytical intentions in data visualization. However, diagnosing the visualization results without understanding the underlying generation process is challenging. Our research explores how to provide explanations for NLIs to help users locate the problems and further revise the queries. We present XNLI, an explainable NLI system for visual data analysis. The system introduces a Provenance Generator to reveal the detailed process of visual transformations, a suite of interactive widgets to support error adjustments, and a Hint Generator to provide query revision hints based on the analysis of user queries and interactions. Two usage scenarios of XNLI and a user study verify the effectiveness and usability of the system. Results suggest that XNLI can significantly enhance task accuracy without interrupting the NLI-based analysis process.
14 pages, 7 figures. A preprint version of a publication at IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023
References in corpus (9)
- Towards Natural Language-Based Visualization Authoring
- Touch? Speech? or Touch and Speech? Investigating Multimodal Interaction for Visual Network Exploration and Analysis
- Collecting and Characterizing Natural Language Utterances for Specifying Data Visualizations
- Interweaving Multimodal Interaction with Flexible Unit Visualizations for Data Exploration
- QueryVis: Logic-based diagrams help users understand complicated SQL queries faster
- Visualizing the Scripts of Data Wrangling with SOMNUS
- RASIPAM: Interactive Pattern Mining of Multivariate Event Sequences in Racket Sports
- DeHumor: Visual Analytics for Decomposing Humor
- nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Task