3.4.4 \(\omega _{j}=\frac {1}{\mu _{j}}\)

The above says that for a regular finite MC, where a stationary probability exist (and is unique), then it is inverse of the mean number of steps between visits \(\mu _{j}\) to state \(j\) in steady state.