Learning interaction rules from multi-animal trajectories via augmented behavioral models

Abstract

Extracting the interaction rules of biological agents from movement sequences pose challenges in various domains. Granger causality is a practical framework for analyzing the interactions from observed time-series data; however, this framework ignores the structures and assumptions of the generative process in animal behaviors, which may lead to interpretational problems and sometimes erroneous assessments of causality. In this paper, we propose a new framework for learning Granger causality from multi-animal trajectories via augmented theory-based behavioral models with interpretable data-driven models. We adopt an approach for augmenting incomplete multi-agent behavioral models described by time-varying dynamical systems with neural networks. For efficient and interpretable learning, our model leverages theory-based architectures separating navigation and motion processes, and the theory-guided regularization for reliable behavioral modeling. This can provide interpretable signs of Granger-causal effects over time, i.e., when specific others cause the approach or separation. In experiments using synthetic datasets, our method achieved better performance than various baselines. We then analyzed multi-animal datasets of mice, flies, birds, and bats, which verified our method and obtained novel biological insights.

arXiv comment24 pages, 5 figures, to appear in NeurIPS 2021

References in corpus (22)

• Measuring Information Transfer
• Collective motion
• Theory-guided Data Science: A New Paradigm for Scientific Discovery from Data
• Hierarchical group dynamics in pigeon flocks
• Towards Robust Interpretability with Self-Explaining Neural Networks
• Universal power law governing pedestrian interactions
• Local information transfer as a spatiotemporal filter for complex systems
• Composing graphical models with neural networks for structured representations and fast inference
• Kernel Granger causality and the analysis of dynamical networks
• The Long Road to Computational Location Privacy: A Survey
• Multiple Futures Prediction
• Validity of time reversal for testing Granger causality
• Generating Long-term Trajectories Using Deep Hierarchical Networks
• Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Data
• Social Attention for Autonomous Decision-Making in Dense Traffic
• Coordinated Multi-Agent Imitation Learning
• Inference of Causal Information Flow in Collective Animal Behavior
• Dynamic mode decomposition in vector-valued reproducing kernel Hilbert spaces for extracting dynamical structure among observables
• SimGANs: Simulator-Based Generative Adversarial Networks for ECG Synthesis to Improve Deep ECG Classification
• Learning recurrent representations for hierarchical behavior modeling
• Discovering Nonlinear Relations with Minimum Predictive Information Regularization
• Dynamical coupling during collective animal motion