6 citations · 8 across the 4 of their papers we have counts for
4 papers · 1 filter
A Generalization of Relative Entropy to Count Vectors and its Concentration Property
Kostas N. Oikonomou
We introduce a new generalization of relative entropy to non-negative vectors with sums . We show in a purely combinatorial setting, with no probabilistic considerations, th…
Generalized Entropy Concentration for Counts
Kostas N. Oikonomou
The phenomenon of entropy concentration provides strong support for the maximum entropy method, MaxEnt, for inferring a probability vector from information in the form of constrain…
Analytical Forms for Most Likely Matrices Derived from Incomplete Information
Kostas N. Oikonomou
Consider a rectangular matrix describing some type of communication or transportation between a set of origins and a set of destinations, or a classification of objects by two attr…
Explicit Bounds for Entropy Concentration under Linear Constraints
Kostas N. Oikonomou, Peter D. Grunwald
Consider the set of all sequences of outcomes, each taking one of values, that satisfy a number of linear constraints. If is fixed while increases, most sequences t…