All Subjects
Light
5.1
Definition and properties of Markov chains
5.2
State space and transition probabilities
5.3
Chapman-Kolmogorov equations
5.4
Stationary distributions
5.5
Absorption and ergodicity
5.6
Hidden Markov models