The Art of Data Science
arXiv:1106.3305 · doi:10.1007/978-1-4614-3323-1_4
Abstract
To flourish in the new data-intensive environment of 21st century science, we need to evolve new skills. These can be expressed in terms of the systemized framework that formed the basis of mediaeval education - the trivium (logic, grammar, and rhetoric) and quadrivium (arithmetic, geometry, music, and astronomy). However, rather than focusing on number, data is the new keystone. We need to understand what rules it obeys, how it is symbolized and communicated and what its relationship to physical space and time is. In this paper, we will review this understanding in terms of the technologies and processes that it requires. We contend that, at least, an appreciation of all these aspects is crucial to enable us to extract scientific information and knowledge from the data sets which threaten to engulf and overwhelm us.
arXiv comment12 pages, invited talk at Astrostatistics and Data Mining in Large Astronomical Databases workshop, La Palma, Spain, 30 May - 3 June 2011, to appear in Springer Series on Astrostatistics
References in corpus (6)
- Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
- First Results from the Catalina Real-time Transient Survey
- Astrophysical Supercomputing with GPUs: Critical Decisions for Early Adopters
- Astronomy in the Cloud: Using MapReduce for Image Coaddition
- Redshift-Space Enhancement of Line-of-Sight Baryon Acoustic Oscillations in the SDSS Main-Galaxy Sample
- Telescopes don't make catalogues!