Let (Xn)n>o be the chain of states S = {0,1,2,3,4,5,6} with transition matrix: P= 0.1 0 0 1 0 0 0.2 0 0.6 0 0.1 0.1 0 0

[answerhappygod]

Let Xn N O Be The Chain Of States S 0 1 2 3 4 5 6 With Transition Matrix P 0 1 0 0 1 0 0 0 2 0 0 6 0 0 1 0 1 0 0 1 (76.84 KiB) Viewed 21 times

Let (Xn)n>o be the chain of states S = {0,1,2,3,4,5,6} with transition matrix: P= 0.1 0 0 1 0 0 0.2 0 0.6 0 0.1 0.1 0 0 0 0 0.3 0 0 0 0.4 0.9 0 0 0 0 0 0.7 0.1 0.4 0 0 0 0 0 0 0 0 0 0 0.7 0 0 0 0 0 0.8 0 0.6 (a) Draw a diagram of the chain. Also find the communication classes and tell if there are absorbing states. (b) Classify the states as recurrent and transient. (c) Calculate pay for all x € S for only one y of your choosing that is in the set {0,2,3,4,6}. (d) How much are P30 and P26 worth? (e) Give the value of Po[N(3) < oo) and P; [N(5) = 0.]. Explain your answer