paper

A Class of Optimal Structures for Node Computations in Message Passing Algorithms

arXiv:2009.02535

Abstract

Consider the computations at a node in a message passing algorithm. Assume that the node has incoming and outgoing messages and , respectively. In this paper, we investigate a class of structures that can be adopted by the node for computing from , where each is computed via a binary tree with leaves excluding . We make three main contributions regarding this class of structures. First, we prove that the minimum complexity of such a structure is , and if a structure has such complexity, its minimum latency is with , where the logarithm always takes base two. Second, we prove that the minimum latency of such a structure is , and if a structure has such latency, its minimum complexity is when is a power of two. Third, given with , we propose a construction for a structure which we conjecture to have the minimum complexity among structures with latencies at most . Our construction method runs in time, and the obtained structure has complexity at most (generally much smaller than) .

Accepted for publication in IEEE Transactions on Information Theory

References in corpus (2)