Velocity formulae between entropy and hitting time for Markov chains

Publication date: October 2018Source: Statistics & Probability Letters, Volume 141Author(s): Michael C.H. ChoiAbstractIn the absence of acceleration, the velocity formula gives “distance travelled equals speed multiplied by time”. For a broad class of Markov chains such as circulant Markov chains or random walk on complete graphs, we prove a probabilistic analogue of the velocity formula between entropy and hitting time, where distance is the entropy of the Markov trajectories from state i to state j in the sense of Ekroot and Cover (1993), speed is the classical entropy rate of the chain, and the time variable is the expected hitting time between i and j. This motivates us to define new entropic counterparts of various hitting time parameters such as average hitting time or commute time, and prove analogous velocity formulae and estimates between these quantities.

Source: Statistics and Probability Letters - July 10, 2018 Category: Statistics Source Type: research