2 Consider A Markov Chain With State Space 1 2 3 4 5 And Transition Probability Matrix 0 3 0 0 2 0 4 0 1 0 1 0 4 1 (33.64 KiB) Viewed 30 times
2. Consider a Markov chain with state space {1, 2, 3, 4, 5} and transition probability matrix 0.3 0 0.2 [0.4 0.1 0.1 0.4 0 0.4 0.1 0 0 0.2 0 0.8 0 0.1 0 0.9 0 0.2 0.1 0.2 0 0.5 P = (a) What are the recurrent and transient states of this Markov chain?
(b) Compute the limiting distribution (denoted by P∞) if it exists. (c) Compute the stationary distribution □ if it exists and compare its entries with those of P for each recurrent state. You may use any software packages.
Join a community of subject matter experts. Register for FREE to view solutions, replies, and use search function. Request answer by replying!