SuperNOVA: Design Strategies and Opportunities for Interactive Visualization in Computational Notebooks
arXiv:2305.03039 · doi:10.1145/3613905.3650848
Abstract
Computational notebooks, such as Jupyter Notebook, have become data scientists' de facto programming environments. Many visualization researchers and practitioners have developed interactive visualization tools that support notebooks, yet little is known about the appropriate design of these tools. To address this critical research gap, we investigate the design strategies in this space by analyzing 163 notebook visualization tools. Our analysis encompasses 64 systems from academic papers and 105 systems sourced from a pool of 55k notebooks containing interactive visualizations that we obtain via scraping 8.6 million notebooks on GitHub. Through this study, we identify key design implications and trade-offs, such as leveraging multimodal data in notebooks as well as balancing the degree of visualization-notebook integration. Furthermore, we provide empirical evidence that tools compatible with more notebook platforms have a greater impact. Finally, we develop SuperNOVA, an open-source interactive browser to help researchers explore existing notebook visualization tools. SuperNOVA is publicly accessible at: https://poloclub.github.io/supernova/.
arXiv commentAccepted at CHI 2024 (Late-Breaking Work). 17 pages, 11 figures, 1 table. SuperNOVA is available at: http://poloclub.github.io/supernova/. The code is available at: https://github.com/poloclub/supernova
References in corpus (31)
- Model Cards for Model Reporting
- BERTopic: Neural topic modeling with a class-based TF-IDF procedure
- The What-If Tool: Interactive Probing of Machine Learning Models
- Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practices
- NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queries
- PyZX: Large Scale Automated Diagrammatic Reasoning
- Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits
- What May Visualization Processes Optimize?
- mage: Fluid Moves Between Code and Graphical Work in Computational Notebooks
- Interactive Dimensionality Reduction for Comparative Analysis
- Symphony: Composing Interactive Interfaces for Machine Learning
- Taggle: Combining Overview and Details in Tabular Data Visualizations
- Notable: On-the-fly Assistant for Data Storytelling in Computational Notebooks
- A User-based Visual Analytics Workflow for Exploratory Model Analysis
- Notebook-as-a-VRE (NaaVRE): from private notebooks to a collaborative cloud virtual research environment
- Aspirations and Practice of Model Documentation: Moving the Needle with Nudging and Traceability
- DataPrep.EDA: Task-Centric Exploratory Data Analysis for Statistical Modeling in Python
- Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design
- PI2: End-to-end Interactive Visualization Interface Generation from Queries
- Causalvis: Visualizations for Causal Inference
- Visualizing a Moving Target: A Design Study on Task Parallel Programs in the Presence of Evolving Data and Concerns
- StickyLand: Breaking the Linear Presentation of Computational Notebooks
- TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualization
- Interpretability, Then What? Editing Machine Learning Models to Reflect Human Knowledge and Values
- Visualization for Trust in Machine Learning Revisited: The State of the Field in 2023
- JOVIAL: Notebook-based Astronomical Data Analysis in the Cloud
- VAINE: Visualization and AI for Natural Experiments
- Argo Lite: Open-Source Interactive Graph Exploration and Visualization in Browsers
- GILP: An Interactive Tool for Visualizing the Simplex Algorithm
- Vizic: A Jupyter-based Interactive Visualization Tool for Astronomical Catalogs
- Interactive (statistical) visualisation and exploration of a billion objects with Vaex