3 papers
cs.LG2026
FMMI: Flow Matching Mutual Information Estimation
Ivan Butakov, Alexander Semenenko, Valeriya Kirova +2
We introduce a novel Mutual Information (MI) estimator that fundamentally reframes the discriminative approach. Instead of training a classifier to discriminate between joint and m…
cs.LG2025
Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence
Alexander Semenenko, Ivan Butakov, Alexey Frolov +1
Sliced Mutual Information (SMI) is widely used as a scalable alternative to mutual information for measuring non-linear statistical dependence. Despite its advantages, such as fast…
cs.LG2025
Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax
Ivan Butakov, Alexander Semenenko, Alexander Tolmachev +3
Deep InfoMax (DIM) is a well-established method for self-supervised representation learning (SSRL) based on maximization of the mutual information between the input and the output…