48 citations · 124 across the 12 of their papers we have counts for
9 papers · 1 filter
Information Loss and Anti-Aliasing Filters in Multirate Systems
Bernhard C. Geiger, Gernot Kubin
This work investigates the information loss in a decimation system, i.e., in a downsampler preceded by an anti-aliasing filter. It is shown that, without a specific signal model in…
On the Rate of Information Loss in Memoryless Systems
Bernhard C. Geiger, Gernot Kubin
In this work we present results about the rate of (relative) information loss induced by passing a real-valued, stationary stochastic process through a memoryless system. We show t…
Information Measures for Deterministic Input-Output Systems
Bernhard C. Geiger, Gernot Kubin
In this work the information loss in deterministic, memoryless systems is investigated by evaluating the conditional entropy of the input random variable given the output random va…
Signal Enhancement as Minimization of Relevant Information Loss
Bernhard C. Geiger, Gernot Kubin
We introduce the notion of relevant information loss for the purpose of casting the signal enhancement problem in information-theoretic terms. We show that many algorithms from mac…
Relative Information Loss in the PCA
Bernhard C. Geiger, Gernot Kubin
In this work we analyze principle component analysis (PCA) as a deterministic input-output system. We show that the relative information loss induced by reducing the dimensionality…
Relative Information Loss - An Introduction
Bernhard C. Geiger, Gernot Kubin
We introduce a relative variant of information loss to characterize the behavior of deterministic input-output systems. We show that the relative loss is closely related to Renyi's…
On the Information Loss in Memoryless Systems: The Multivariate Case
Bernhard C. Geiger, Gernot Kubin
In this work we give a concise definition of information loss from a system-theoretic point of view. Based on this definition, we analyze the information loss in static input-outpu…
Some Results on the Information Loss in Dynamical Systems
Bernhard C. Geiger, Gernot Kubin
In this work we investigate the information loss in (nonlinear) dynamical input-output systems and provide some general results. In particular, we present an upper bound on the inf…
Information Loss in Static Nonlinearities
Bernhard C. Geiger, Christian Feldbauer, Gernot Kubin
In this work, conditional entropy is used to quantify the information loss induced by passing a continuous random variable through a memoryless nonlinear input-output system. We de…