activity
20132025
most citedLearning Representations for Neural Network-Based Classification Using the Information Bottleneck Principle

200 citations · 433 across the 16 of their papers we have counts for

collaborators
Showing cs.ITShow all

7 papers · 1 filter

cs.IT2020

Invertible Low-Divergence Coding

Patrick Schulte, Rana Ali Amjad, Thomas Wiegart +1

Several applications in communication, control, and learning require approximating target distributions to within small informational divergence (I-divergence). The additional requ…

cs.IT2018★ 2 cited

Information Rates and Error Exponents for Probabilistic Amplitude Shaping

Rana Ali Amjad

Probabilistic Amplitude Shaping (PAS) is a coded-modulation scheme in which the encoder is a concatenation of a distribution matcher with a systematic Forward Error Correction (FEC…

cs.IT2016★ 3 cited

Hard Clusters Maximize Mutual Information

Bernhard C. Geiger, Rana Ali Amjad

In this paper, we investigate mutual information as a cost function for clustering, and show in which cases hard, i.e., deterministic, clusters are optimal. Using convexity propert…

cs.IT2013

Informational Divergence and Entropy Rate on Rooted Trees with Probabilities

Georg Böcherer, Rana Ali Amjad

Rooted trees with probabilities are used to analyze properties of a variable length code. A bound is derived on the difference between the entropy rates of the code and a memoryles…

cs.IT2013

Fixed-to-Variable Length Resolution Coding for Target Distributions

Georg Böcherer, Rana Ali Amjad

The number of random bits required to approximate a target distribution in terms of un-normalized informational divergence is considered. It is shown that for a variable-to-variabl…

cs.IT2013★ 4 cited

Block-to-Block Distribution Matching

Georg Böcherer, Rana Ali Amjad

In this work, binary block-to-block distribution matching is considered. m independent and uniformly distributed bits are mapped to n output bits resembling a target product distri…

cs.IT2013★ 1 cited

Fixed-to-Variable Length Distribution Matching

Rana Ali Amjad, Georg Böcherer

Fixed-to-variable length (f2v) matchers are used to reversibly transform an input sequence of independent and uniformly distributed bits into an output sequence of bits that are (a…