Consistency in Models for Distributed Learning under Communication Constraints

Abstract

Motivated by sensor networks and other distributed settings, several models for distributed learning are presented. The models differ from classical works in statistical pattern recognition by allocating observations of an independent and identically distributed (i.i.d.) sampling process amongst members of a network of simple learning agents. The agents are limited in their ability to communicate to a central fusion center and thus, the amount of information available for use in classification or regression is constrained. For several basic communication models in both the binary classification and regression frameworks, we question the existence of agent decision rules and fusion rules that result in a universally consistent ensemble. The answers to this question present new issues to consider with regard to universal consistency. Insofar as these models present a useful picture of distributed scenarios, this paper addresses the issue of whether or not the guarantees provided by Stone's Theorem in centralized environments hold in distributed settings.

To appear in the IEEE Transactions on Information Theory

References in corpus (1)

• Distributed Learning in Wireless Sensor Networks

Cited by in corpus (5)

• Distributed Learning in Wireless Sensor Networks
• Optimal Power Allocation for Distributed Detection over MIMO Channels in Wireless Sensor Networks
• Distributed Kernel Regression: An Algorithm for Training Collaboratively
• Why Interpretability in Machine Learning? An Answer Using Distributed Detection and Data Fusion Theory
• Nonparametric Decentralized Detection and Sparse Sensor Selection via Multi-Sensor Online Kernel Scalar Quantization