Fairness in Forecasting and Learning Linear Dynamical Systems

Abstract

In machine learning, training data often capture the behaviour of multiple subgroups of some underlying human population. When the amounts of training data for the subgroups are not controlled carefully, under-representation bias arises. We introduce two natural notions of subgroup fairness and instantaneous fairness to address such under-representation bias in time-series forecasting problems. In particular, we consider the subgroup-fair and instant-fair learning of a linear dynamical system (LDS) from multiple trajectories of varying lengths, and the associated forecasting problems. We provide globally convergent methods for the learning problems using hierarchies of convexifications of non-commutative polynomial optimisation problems. Our empirical results on a biased data set motivated by insurance applications and the well-known COMPAS data set demonstrate both the beneficial impact of fairness considerations on statistical performance and encouraging effects of exploiting sparsity on run time.

References in corpus (18)

• SMOTE: Synthetic Minority Over-sampling Technique
• Equality of Opportunity in Supervised Learning
• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
• Counterfactual Fairness
• Fairness Without Demographics in Repeated Loss Minimization
• On Formalizing Fairness in Prediction with Machine Learning
• On the relation between accuracy and fairness in binary classification
• Algorithm 950: Ncpol2sdpa---Sparse Semidefinite Programming Relaxations for Polynomial Optimization Problems of Noncommuting Variables
• The Price of Fair PCA: One Extra Dimension
• Near optimal finite time identification of arbitrary linear dynamical systems
• Online Learning for Time Series Prediction
• Causal Inference by Identification of Vector Autoregressive Processes with Hidden Components
• Sparse Noncommutative Polynomial Optimization
• Learning Linear Dynamical Systems with Semi-Parametric Least Squares
• TSSOS: A Moment-SOS hierarchy that exploits term sparsity
• Multi-Criteria Dimensionality Reduction with Applications to Fairness
• Dynamic fairness - Breaking vicious cycles in automatic decision making
• Sample Complexity of Kalman Filtering for Unknown Systems

Cited by in corpus (4)

• TSSOS: a Julia library to exploit sparsity for large-scale polynomial optimization
• Fairness in Forecasting of Observations of Linear Dynamical Systems
• Exploiting term sparsity in Noncommutative Polynomial Optimization
• SparseJSR: A Fast Algorithm to Compute Joint Spectral Radius via Sparse SOS Decompositions