Lossy Joint Source-Channel Coding over Unknown Channels

Abstract

We analyze the performance of joint source-channel codes in an unknown-channel framework, where the true channel is unknown but the source distribution is known. We derive achievability bounds for a family of mismatched-design joint source-channel codes constructed for a design channel $Q_{Y|X}$ and operated over a possibly different true channel $P_{Y|X}$. Our one-shot achievability bound allows for standard Borel alphabets for the source, reproduction, channel input and channel output. The subsequent block coding result based on the normal approximation applies to stationary memoryless sources and memoryless, possibly nonstationary channels under regularity and moment conditions. The achievability bound is given in terms of the rate-distortion and rate-dispersion functions, as well as two channel-dependent quantities that we call the mismatched-design rate and mismatched-design rate-dispersion. We use a family of Gibbs posteriors parameterized by a single scalar as decoder-side kernels, and the envelope of the corresponding achievable rates recovers the generalized mutual information. In the stationary matched setting covered by our assumptions, our result recovers the achievability part of Kostina and Verdú's 2013 Gaussian approximation result and improves its third-order term. We also formalize a notion of a second-order universal family of source-channel codes under which there is no first- or second-order asymptotic penalty. We then construct two channel-blind families of source-channel codes: one that is second-order universal over a regular class of nonstationary block erasure channels and another that is second-order universal over stationary Gaussian channels. Our code construction uses Poisson functional representations of suitable conditional probability measures to produce the encoder and decoder outputs.