64 citations · 243 across the 40 of their papers we have counts for
4 papers · 1 filter
Optimal Quantization for Matrix Multiplication
Or Ordentlich, Yury Polyanskiy
Recent work in machine learning community proposed multiple methods for performing lossy compression (quantization) of large matrices. This quantization is important for accelerati…
The strong data processing inequality under the heat flow
Bo'az Klartag, Or Ordentlich
Let and be probability distributions on , and be their evolution under the heat flow, that is, the probability distributions resulting from convolvi…
Memory Complexity of Estimating Entropy and Mutual Information
Tomer Berg, Or Ordentlich, Ofer Shayevitz
We observe an infinite sequence of independent identically distributed random variables drawn from an unknown distribution over , and our goal is to estim…
Lower Bounds on Mutual Information for Linear Codes Transmitted over Binary Input Channels, and for Information Combining
Uri Erez, Or Ordentlich, Shlomo Shamai
It has been known for a long time that the mutual information between the input sequence and output of a binary symmetric channel (BSC) is upper bounded by the mutual information b…