Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networks

Abstract

A computational graph in a deep neural network (DNN) denotes a specific data flow diagram (DFD) composed of many tensors and operators. Existing toolkits for visualizing computational graphs are not applicable when the structure is highly complicated and large-scale (e.g., BERT [1]). To address this problem, we propose leveraging a suite of visual simplification techniques, including a cycle-removing method, a module-based edge-pruning algorithm, and an isomorphic subgraph stacking strategy. We design and implement an interactive visualization system that is suitable for computational graphs with up to 10 thousand elements. Experimental results and usage scenarios demonstrate that our tool reduces 60% elements on average and hence enhances the performance for recognizing and diagnosing DNN models. Our contributions are integrated into an open-source DNN visualization toolkit, namely, MindInsight [2].

References in corpus (7)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• TensorFlow: A system for large-scale machine learning
• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models
• The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations
• FairSight: Visual Analytics for Fairness in Decision Making
• Net2Vis -- A Visual Grammar for Automatically Generating Publication-Tailored CNN Architecture Visualizations