Toward Building Science Discovery Machines

Abstract

The dream of building machines that can do science has inspired scientists for decades. Remarkable advances have been made recently; however, we are still far from achieving this goal. In this paper, we focus on the scientific discovery process where a high level of reasoning and remarkable problem-solving ability are required. We review different machine learning techniques used in scientific discovery with their limitations. We survey and discuss the main principles driving the scientific discovery process. These principles are used in different fields and by different scientists to solve problems and discover new knowledge. We provide many examples of the use of these principles in different fields such as physics, mathematics, and biology. We also review AI systems that attempt to implement some of these principles. We argue that building science discovery machines should be guided by these principles as an alternative to the dominant approach of current AI systems that focuses on narrow objectives. Building machines that fully incorporate these principles in an automated way might open the doors for many advancements.

References in corpus (24)

• Power laws, Pareto distributions and Zipf's law
• Machine learning and the physical sciences
• Shortcut Learning in Deep Neural Networks
• Explainable Machine Learning for Scientific Insights and Discoveries
• Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science
• Discovering physical concepts with neural networks
• Deep Learning: A Critical Appraisal
• Autonomous discovery in the chemical sciences part II: Outlook
• Neural-Symbolic Learning and Reasoning: A Survey and Interpretation
• Measuring abstract reasoning in neural networks
• Abstraction and Analogy-Making in Artificial Intelligence
• Toward an AI Physicist for Unsupervised Learning
• Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoning
• Explainable Artificial Intelligence: a Systematic Review
• Analysing Mathematical Reasoning Abilities of Neural Models
• 3D G-CNNs for Pulmonary Nodule Detection
• A Survey of Deep Learning for Scientific Discovery
• Unsupervised Learning of Latent Physical Properties Using Perception-Prediction Networks
• AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligence
• Learning to Make Analogies by Contrasting Abstract Relational Structure
• Learning Perceptual Inference by Contrasting
• RAVEN: A Dataset for Relational and Analogical Visual rEasoNing
• The General Theory of General Intelligence: A Pragmatic Patternist Perspective
• Self-Organizing Intelligent Matter: A blueprint for an AI generating algorithm