Using Jupyter for reproducible scientific workflows

Abstract

Literate computing has emerged as an important tool for computational studies and open science, with growing folklore of best practices. In this work, we report two case studies - one in computational magnetism and another in computational mathematics - where domain-specific software was exposed to the Jupyter environment. This enables high-level control of simulations and computation, interactive exploration of computational results, batch processing on HPC resources, and reproducible workflow documentation in Jupyter notebooks. In the first study, Ubermag drives existing computational micromagnetics software through a domain-specific language embedded in Python. In the second study, a dedicated Jupyter kernel interfaces with the GAP system for computational discrete algebra and its dedicated programming language. In light of these case studies, we discuss the benefits of this approach, including progress toward more reproducible and reusable research results and outputs, notably through the use of infrastructure such as JupyterHub and Binder.

11 pages, 3 figures

References in corpus (4)

• User interfaces for computational science: a domain specific language for OOMMF embedded in Python
• Stable and manipulable Bloch point
• Adjoint representations of black box groups ${\mathrm{PSL}}_2({\mathbb{F}}_q)$
• Frequency-based nanoparticle sensing over large field ranges using the ferromagnetic resonances of a magnetic nanodisc

Cited by in corpus (15)

• Ubermag: Towards more effective micromagnetic workflows
• GW250114: testing Hawking's area law and the Kerr nature of black holes
• Eliciting Best Practices for Collaboration with Computational Notebooks
• Photon shot-noise limited transient absorption soft X-ray spectroscopy at the European XFEL
• The Quenched Satellite Population Around Milky Way Analogs
• A RoboStack Tutorial: Using the Robot Operating System Alongside the Conda and Jupyter Data Science Ecosystems
• Environmental Dependence of Type Ia Supernovae in Low-Redshift Galaxy Clusters
• LensWatch. II. Improved Photometry and Time-delay Constraints on the Strongly Lensed Type Ia Supernova 2022qmx ("SN Zwicky") with HST Template Observations
• Formal Definition and Implementation of Reproducibility Tenets for Computational Workflows
• New ultracool dwarf candidates from multi-epoch WISE data
• Controlling stable Bloch points with electric currents
• Numerical simulation projects in micromagnetics with Jupyter
• A Systematic Literature Review of Software Engineering Research on Jupyter Notebook
• The AutoSPADA Platform: User-Friendly Edge Computing for Distributed Learning and Data Analytics in Connected Vehicles
• Similarity-Based Assessment of Computational Reproducibility in Jupyter Notebooks