4) Consider the Markov chain that has the following (one-step) transition matrix. 0 1 2 3 4 5 0 ½ % 0 0 0 0 1 % ½ 0 0 0

[answerhappygod]

4 Consider The Markov Chain That Has The Following One Step Transition Matrix 0 1 2 3 4 5 0 0 0 0 0 1 0 0 0 1 (39.99 KiB) Viewed 10 times

4) Consider the Markov chain that has the following (one-step) transition matrix. 0 1 2 3 4 5 0 ½ % 0 0 0 0 1 % ½ 0 0 0 0 2 ½ 4 ½ ½ 0 0 ½ 3 0 0 0 ¾ % 0 4 0 0 0 ½ ½ 0 5 0 0 0 0 0 1 (a) How many classes are there in this MC? Explain briefly. (b) Indicate which states are transient, which states are recurrent. Explain briefly. (c) Find the period of all states. (d) Explain if this Markov Chain is reducible or irreducible. P=