6 citations · 26 across the 32 of their papers we have counts for
4 papers · 2 filters
Analytic Formulas for Renyi Entropy of Hidden Markov Models
Joachim Breitner, Maciej Skorski
Determining entropy rates of stochastic processes is a fundamental and difficult problem, with closed-form solutions known only for specific cases. This paper pushes the state-of-t…
Entropy of Independent Experiments, Revisited
Maciej Skorski
The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate.…
Strong Chain Rules for Min-Entropy under Few Bits Spoiled
Maciej Skorski
It is well established that the notion of min-entropy fails to satisfy the \emph{chain rule} of the form , known for Shannon Entropy. Such a property would he…
On the Complexity of Estimating Renyi Divergences
Maciej Skorski
This paper studies the complexity of estimating Renyi divergences of discrete distributions: observed from samples and the baseline distribution known \emph{a priori}. Exte…