8 citations · 44 across the 25 of their papers we have counts for
5 papers · 1 filter
Introduction to Logical Entropy and its Relationship to Shannon Entropy
David Ellerman
We live in the information age. Claude Shannon, as the father of the information age, gave us a theory of communications that quantified an "amount of information," but, as he poin…
Generative Mechanisms: The mechanisms that implement codes
David Ellerman
The purpose of this paper is to abstractly describe the notion of a generative mechanism that implements a code and to provide a number of examples including the DNA-RNA machinery…
What can (partition) logic contribute to information theory?
David Ellerman
Logical probability theory was developed as a quantitative measure based on Boole's logic of subsets. But information theory was developed into a mature theory by Claude Shannon wi…
Information as Distinctions: New Foundations for Information Theory
David Ellerman
The logical basis for information theory is the newly developed logic of partitions that is dual to the usual Boolean logic of subsets. The key concept is a "distinction" of a part…
Counting Distinctions: On the Conceptual Foundations of Shannon's Information Theory
David Ellerman
Categorical logic has shown that modern logic is essentially the logic of subsets (or "subobjects"). Partitions are dual to subsets so there is a dual logic of partitions where a "…