Towards Understanding How Readers Integrate Charts and Captions: A Case Study with Line Charts
arXiv:2101.08235 · doi:10.1145/3411764.3445443
Abstract
Charts often contain visually prominent features that draw attention to aspects of the data and include text captions that emphasize aspects of the data. Through a crowdsourced study, we explore how readers gather takeaways when considering charts and captions together. We first ask participants to mark visually prominent regions in a set of line charts. We then generate text captions based on the prominent features and ask participants to report their takeaways after observing chart-caption pairs. We find that when both the chart and caption describe a high-prominence feature, readers treat the doubly emphasized high-prominence feature as the takeaway; when the caption describes a low-prominence chart feature, readers rely on the chart and report a higher-prominence feature as the takeaway. We also find that external information that provides context, helps further convey the caption's message to the reader. We use these findings to provide guidelines for authoring effective chart-caption pairs.
arXiv commentTo appear at CHI 2021
Cited by in corpus (13)
- Towards Natural Language Interfaces for Data Visualization: A Survey
- Striking a Balance: Reader Takeaways and Preferences when Integrating Text and Charts
- The Reality of the Situation: A Survey of Situated Analytics
- The Role of Text in Visualizations: How Annotations Shape Perceptions of Bias and Influence Predictions
- Natural Language Dataset Generation Framework for Visualizations Powered by Large Language Models
- My Model is Unfair, Do People Even Care? Visual Design Affects Trust and Perceived Bias in Machine Learning
- How Do Viewers Synthesize Conflicting Information from Data Visualizations?
- SciCapenter: Supporting Caption Composition for Scientific Figures with Machine-Generated Captions and Ratings
- EmphasisChecker: A Tool for Guiding Chart and Caption Emphasis
- "The Data Says Otherwise"-Towards Automated Fact-checking and Communication of Data Claims
- "Piecing Data Connections Together Like a Puzzle": Effects of Increasing Task Complexity on the Effectiveness of Data Storytelling Enhanced Visualisations
- Cognitive Affordances in Visualization: Related Constructs, Design Factors, and Framework
- VBridge: Connecting the Dots Between Features and Data to Explain Healthcare Models