Markov chains
Discrete-time Markov chains (construction, path measures, finite-dimensional distributions, Chapman–Kolmogorov, Markov and strong Markov properties), finite chains, ergodicity and convergence to stationarity, mixing, reversibility and Kolmogorov's cycle criterion, and finite continuous-time Markov chains with rate matrices, semigroups and hitting times.
- Chapman–Kolmogorov equations
- Finite continuous-time Markov chains
- Finite-dimensional distributions of Markov chains
- Kolmogorov's criterion for reversibility
- Finite Markov chains
- Construction of Markov chains
- Markov and strong Markov properties
- Markov processes from transition semigroups
- Mixing times of Markov chains
- Convergence theorem for finite Markov chains
Loading dependency explorer…
The dependency explorer needs JavaScript and its graph data.