SciServer: a Science Platform for Astronomy and Beyond

Abstract

We present SciServer, a science platform built and supported by the Institute for Data Intensive Engineering and Science at the Johns Hopkins University. SciServer builds upon and extends the SkyServer system of server-side tools that introduced the astronomical community to SQL (Structured Query Language) and has been serving the Sloan Digital Sky Survey catalog data to the public. SciServer uses a Docker/VM based architecture to provide interactive and batch mode server-side analysis with scripting languages like Python and R in various environments including Jupyter (notebooks), RStudio and command-line in addition to traditional SQL-based data analysis. Users have access to private file storage as well as personal SQL database space. A flexible resource access control system allows users to share their resources with collaborators, a feature that has also been very useful in classroom environments. All these services, wrapped in a layer of REST APIs, constitute a scalable collaborative data-driven science platform that is attractive to science disciplines beyond astronomy.

Accepted for publication in the Astronomy and Computing journal

References in corpus (2)

• Searchable Sky Coverage of Astronomical Observations: Footprints and Exposures
• A Deep Proper Motion Catalog Within The Sloan Digital Sky Survey Footprint

Cited by in corpus (19)

• An emission state switching radio transient with a 54 minute period
• Genuine Retrieval of the AGN Host Stellar Population (GRAHSP)
• Radial phase spirals in the Solar neighbourhood
• Indra: a Public Computationally Accessible Suite of Cosmological $N$-body Simulations
• Clustering of vector nulls in homogeneous isotropic turbulence
• UVIT view of Centaurus A; a detailed study on positive AGN feedback
• The Average Soft X-ray Spectra of eROSITA Active Galactic Nuclei
• A Time-Dependent Spectral Analysis of $\gamma$ Cassiopeiae
• Complementary Cosmological Simulations
• The Seventeenth Data Release of the Sloan Digital Sky Surveys: Complete Release of MaNGA, MaStar and APOGEE-2 Data
• AstroInspect: a web-based system to organize, assess, and visually inspect astronomical objects
• AstroClearNet: Deep image prior for multi-frame astronomical image restoration
• A simple, flexible method for timing cross-calibration of space missions
• Periodic Radio and X-ray Emission from an Accreting White Dwarf Binary
• Active galactic nucleus feedback in NGC 3982
• Globally optimal and scalable $N$-way matching of astronomy catalogs
• ImageMM: Joint multi-frame image restoration and super-resolution
• SAS in ESA Datalabs: A New Platform for XMM-Newton Analysis
• VarIabiLity seLection of AstrophysIcal sources iN PTF (VILLAIN) I. Structure function fits to 71 million objects