Answer Happy

Posted: **Fri Jul 01, 2022 9:08 am**

: 2 Consider A Markov Chain With State Space 1 2 3 4 5 And Transition Probability Matrix 0 3 0 0 2 0 4 0 1 0 1 0 4 1 (33.64 KiB) Viewed 31 times

2. Consider a Markov chain with state space {1, 2, 3, 4, 5} and transition probability matrix 0.3 0 0.2 [0.4 0.1 0.1 0.4 0 0.4 0.1 0 0 0.2 0 0.8 0 0.1 0 0.9 0 0.2 0.1 0.2 0 0.5 P = (a) What are the recurrent and transient states of this Markov chain?
(b) Compute the limiting distribution (denoted by P∞) if it exists. (c) Compute the stationary distribution □ if it exists and compare its entries with those of P for each recurrent state. You may use any software packages.