activity
20182023
most citedOn Relations Between the Relative entropy and -Divergence, Generalizations and Applications

20 citations · 58 across the 20 of their papers we have counts for

collaborators

20 papers

cond-mat.stat-mech2023★ 1 cited

Upper bound for entropy production in Markov processes

Tomohiro Nishiyama, Yoshihiko Hasegawa

The second law of thermodynamics states that entropy production cannot be negative. Recent developments concerning uncertainty relations in stochastic thermodynamics, such as therm…

cond-mat.stat-mech2023★ 14 cited

Effective estimation of entropy production with lacking data

Marco Baiesi, Tomohiro Nishiyama, Gianmaria Falasco

Observing stochastic trajectories with rare transitions between states, practically undetectable on time scales accessible to experiments, makes it impossible to directly quantify…

math.PR2022

Lower Bounds for the Total Variation Distance Given Means and Variances of Distributions

Tomohiro Nishiyama

For arbitrary two probability measures on real d-space with given means and variances (covariance matrices), we provide lower bounds for their total variation distance. In the one-…

cs.IT2022

On Relations Between Tight Bounds for Symmetric -Divergences and Binary Divergences

Tomohiro Nishiyama

Minimizing divergence measures under a constraint is an important problem. We derive a sufficient condition that binary divergence measures provide lower bounds for symmetric diver…

cond-mat.stat-mech2022

Thermodynamic-kinetic uncertainty relation: properties and an information-theoretic interpretation

Tomohiro Nishiyama

Universal relations that characterize the fluctuations of nonequilibrium systems are of fundamental importance. The thermodynamic and kinetic uncertainty relations impose upper bou…

cs.IT2021

Tight Lower Bounds for -Divergences Under Moment Constraints and Relations Between Different

Tomohiro Nishiyama

The -divergences include the well-known Kullback-Leibler divergence, Hellinger distance and -divergence. In this paper, we derive differential and integral relations betwee…

cs.IT2020★ 9 cited

A Tight Lower Bound for the Hellinger Distance with Given Means and Variances

Tomohiro Nishiyama

The binary divergences that are divergences between probability measures defined on the same 2-point set have an interesting property. For the chi-squared divergence and the relati…

cs.IT2020★ 20 cited

On Relations Between the Relative entropy and -Divergence, Generalizations and Applications

Tomohiro Nishiyama, Igal Sason

The relative entropy and chi-squared divergence are fundamental divergence measures in information theory and statistics. This paper is focused on a study of integral relations bet…

cs.IT2020

Convex Optimization on Functionals of Probability Densities

Tomohiro Nishiyama

In information theory, some optimization problems result in convex optimization problems on strictly convex functionals of probability densities. In this note, we study these probl…

cs.IT2020★ 1 cited

Minimization Problems on Strictly Convex Divergences

Tomohiro Nishiyama

The divergence minimization problem plays an important role in various fields. In this note, we focus on differentiable and strictly convex divergences. For some minimization probl…

math.ST2019★ 2 cited

Monotonically Decreasing Sequence of Divergences

Tomohiro Nishiyama

Divergences are quantities that measure discrepancy between two probability distributions and play an important role in various fields such as statistics and machine learning. Dive…

math.ST2019★ 3 cited

A New Lower Bound for Kullback-Leibler Divergence Based on Hammersley-Chapman-Robbins Bound

Tomohiro Nishiyama

In this paper, we derive a useful lower bound for the Kullback-Leibler divergence (KL-divergence) based on the Hammersley-Chapman-Robbins bound (HCRB). The HCRB states that the var…

math.ST2019★ 1 cited

Cramér-Rao-type Bound and Stam's Inequality for Discrete Random Variables

Tomohiro Nishiyama

The variance and the entropy power of a continuous random variable are bounded from below by the reciprocal of its Fisher information through the Cramér-Rao bound and the Stam's in…

math.ST2019

Inequalities between -norms for log-concave distributions

Tomohiro Nishiyama

Log-concave distributions include some important distributions such as normal distribution, exponential distribution and so on. In this note, we show inequalities between two Lp-no…

math.ST2019

-norm inequality using q-moment and its applications

Tomohiro Nishiyama

For a measurable function on a set which has a finite measure, an inequality holds between two Lp-norms. In this paper, we show similar inequalities for the Euclidean space and the…

cs.LG2018★ 1 cited

Divergence Network: Graphical calculation method of divergence functions

Tomohiro Nishiyama

In this paper, we introduce directed networks called `divergence network' in order to perform graphical calculation of divergence functions. By using the divergence networks, we ca…

stat.ME2018★ 1 cited

Sum decomposition of divergence into three divergences

Tomohiro Nishiyama

Divergence functions play a key role as to measure the discrepancy between two points in the field of machine learning, statistics and signal processing. Well-known divergences are…

math.ST2018★ 2 cited

Generalized Bregman and Jensen divergences which include some f-divergences

Tomohiro Nishiyama

In this paper, we introduce new classes of divergences by extending the definitions of the Bregman divergence and the skew Jensen divergence. These new divergence classes (g-Bregma…

stat.ME2018★ 1 cited

Divergence functions in dually flat spaces and their properties

Tomohiro Nishiyama

In the field of statistics, many kind of divergence functions have been studied as an amount which measures the discrepancy between two probability distributions. In the differenti…

stat.ME2018★ 2 cited

Improved Chebyshev inequality: new probability bounds with known supremum of PDF

Tomohiro Nishiyama

In this paper, we derive new probability bounds for Chebyshev's inequality if the supremum of the probability density function is known. This result holds for one-dimensional or mu…