59 citations · 95 across the 15 of their papers we have counts for
14 papers · 1 filter
On Functions of Markov Random Fields
Bernhard C. Geiger, Ali Al-Bashabsheh
We derive two sufficient conditions for a function of a Markov random field (MRF) on a given graph to be a MRF on the same graph. The first condition is information-theoretic and p…
Neural Entropic Estimation: A faster path to mutual information estimation
Chung Chan, Ali Al-Bashabsheh, Hing Pang Huang +3
We point out a limitation of the mutual information neural estimation (MINE) where the network fails to learn at the initial training phase, leading to slow convergence in the numb…
Info-Clustering: An Efficient Algorithm by Network Information Flow
Chung Chan, Ali Al-Bashabsheh, Qiaoqiao Zhou
Motivated by the fact that entities in a social network or biological system often interact by exchanging information, we propose an efficient info-clustering algorithm that can gr…
Duality between Feature Selection and Data Clustering
Chung Chan, Ali Al-Bashabsheh, Qiaoqiao Zhou +1
The feature-selection problem is formulated from an information-theoretic perspective. We show that the problem can be efficiently solved by an extension of the recently proposed i…
A Factor-Graph Approach to Algebraic Topology, With Applications to Kramers--Wannier Duality
Ali Al-Bashabsheh, Pascal O. Vontobel
Algebraic topology studies topological spaces with the help of tools from abstract algebra. The main focus of this paper is to show that many concepts from algebraic topology can b…
Incremental and Decremental Secret Key Agreement
Chung Chan, Ali Al-Bashabsheh, Qiaoqiao Zhou
We study the rate of change of the multivariate mutual information among a set of random variables when some common randomness is added to or removed from a subset. This is formula…