Finite Markov Chain Imbedding
The following sections are included:
Finite Markov Chain
Chapman-Kolmogorov Equation
Tree-Structured Markov Chain
Runs and Patterns
Finite Markov Chain Imbedding
Absorbing State
First-Entry Probability
The following sections are included:
Finite Markov Chain
Chapman-Kolmogorov Equation
Tree-Structured Markov Chain
Runs and Patterns
Finite Markov Chain Imbedding
Absorbing State
First-Entry Probability