Scientific Data Mining in Astronomy
arXiv:0911.0505
Abstract
We describe the application of data mining algorithms to research problems in astronomy. We posit that data mining has always been fundamental to astronomical research, since data mining is the basis of evidence-based discovery, including classification, clustering, and novelty discovery. These algorithms represent a major set of computational tools for discovery in large databases, which will be increasingly essential in the era of data-intensive astronomy. Historical examples of data mining in astronomy are reviewed, followed by a discussion of one of the largest data-producing projects anticipated for the coming decade: the Large Synoptic Survey Telescope (LSST). To facilitate data-driven discoveries in astronomy, we envision a new data-oriented research paradigm for astronomy and astrophysics -- astroinformatics. Astroinformatics is described as both a research approach and an educational imperative for modern data-intensive astronomy. An important application area for large time-domain sky surveys (such as LSST) is the rapid identification, characterization, and classification of real-time sky events (including moving objects, photometrically variable objects, and the appearance of transients). We describe one possible implementation of a classification broker for such events, which incorporates several astroinformatics techniques: user annotation, semantic tagging, metadata markup, heterogeneous data integration, and distributed data mining. Examples of these types of collaborative classification and discovery approaches within other science disciplines are presented.
26 pages
References in corpus (22)
- Data Mining and Machine Learning in Astronomy
- Galaxy Types in the Sloan Digital Sky Survey Using Supervised Artificial Neural Networks
- Probabilistic Cross-Identification of Astronomical Sources
- Estimating Photometric Redshifts Using Support Vector Machines
- AUTOMATED MORPHOLOGICAL CLASSIFICATION OF APM GALAXIES BY SUPERVISED ARTIFICIAL NEURAL NETWORKS
- Robust Machine Learning Applied to Astronomical Datasets I: Star-Galaxy Classification of the SDSS DR3 Using Decision Trees
- Novel Methods for Predicting Photometric Redshifts from Broad Band Photometry using Virtual Sensors
- Wide Field Imaging. I. Applications of Neural Networks to object detection and star/galaxy classification
- Monitoring All Sky for Variability
- Robust Machine Learning Applied to Astronomical Datasets II: Quantifying Photometric Redshifts for Quasars Using Instance-Based Learning
- A Census of Object Types and Redshift Estimates in the SDSS Photometric Catalog from a Trained Decision-Tree Classifier
- A Principal Component Analysis approach to the Star Formation History of elliptical galaxies in Compact Groups
- Monolithic or hierarchical star formation? A new statistical analysis
- A difference boosting neural network for automated star-galaxy classification
- Two novel approaches for photometric redshift estimation based on SDSS and 2MASS databases
- Matching Catalogues by Probabilistic Pattern Classification
- Towards a Real-time Transient Classification Engine
- Exploration of Large Digital Sky Surveys
- The Revolution in Astronomy Education: Data Science for the Masses
- Data Mining in Astronomical Databases
- Robust Machine Learning Applied to Terascale Astronomical Datasets
- Automated object classification with ClassX