Chapter 4: General Markov Processes
The following sections are included:
Markov Property and Its Equivalence
Strong Markov Property
Appendix: Optimal Stopping Problem—The Secretary Problem
Supplements and Exercises
The following sections are included:
Markov Property and Its Equivalence
Strong Markov Property
Appendix: Optimal Stopping Problem—The Secretary Problem
Supplements and Exercises