Machine Learning and Deep Learning -- A review for Ecologists

Abstract

1. The popularity of Machine learning (ML), Deep learning (DL), and Artificial intelligence (AI) has risen sharply in recent years. Despite this spike in popularity, the inner workings of ML and DL algorithms are often perceived as opaque, and their relationship to classical data analysis tools remains debated. 2. Although it is often assumed that ML and DL excel primarily at making predictions, ML and DL can also be used for analytical tasks traditionally addressed with statistical models. Moreover, most recent discussions and reviews on ML focus mainly on DL, missing out on synthesizing the wealth of ML algorithms with different advantages and general principles. 3. Here, we provide a comprehensive overview of the field of ML and DL, starting by summarizing its historical developments, existing algorithm families, differences to traditional statistical tools, and universal ML principles. We then discuss why and when ML and DL models excel at prediction tasks and where they could offer alternatives to traditional statistical methods for inference, highlighting current and emerging applications for ecological problems. Finally, we summarize emerging trends such as scientific and causal ML, explainable AI, and responsible AI that may significantly impact ecological data analysis in the future. 4. We conclude that ML and DL are powerful new tools for predictive modeling and data analysis. The superior performance of ML and DL algorithms compared to statistical models can be explained by their higher flexibility and automatic data-dependent complexity optimization. However, their use for causal inference is still disputed as the focus of ML and DL methods on predictions creates challenges for the interpretation of these models. Nevertheless, we expect ML and DL to become an indispensable tool in E&E, comparable to other traditional statistical tools.

62 pages, 10 figures

References in corpus (12)

• Equality of Opportunity in Supervised Learning
• Seeing biodiversity: perspectives in machine learning for wildlife conservation
• The Unreasonable Effectiveness of Deep Learning in Artificial Intelligence
• Neural Tangents: Fast and Easy Infinite Neural Networks in Python
• Deep Symbolic Regression for Recurrent Sequences
• The evidence contained in the P-value is context dependent
• Relating Graph Neural Networks to Structural Causal Models
• Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning
• The Low-Rank Simplicity Bias in Deep Networks
• Robustness to Pruning Predicts Generalization in Deep Neural Networks
• TIML: Task-Informed Meta-Learning for Agriculture
• Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks

Cited by in corpus (3)

• Novel community data in ecology -- properties and prospects
• Unveiling the frontiers of deep learning: innovations shaping diverse domains
• Foundation for unbiased cross-validation of spatio-temporal models for species distribution modeling