Page 1 of 1
Let (Xn)n>1 be a Markov chain with state space S = {0, 1, 2, 3,...} and with transition probabilities given by P(x, y) =
Posted: Mon May 09, 2022 12:02 pm
by answerhappygod
- Let Xn N 1 Be A Markov Chain With State Space S 0 1 2 3 And With Transition Probabilities Given By P X Y 1 (67.85 KiB) Viewed 30 times
Let (Xn)n>1 be a Markov chain with state space S = {0, 1, 2, 3,...} and with transition probabilities given by P(x, y) = Pi, 1, 0, if x = 0, y = i if x > 1, y = -1 another case Where los {Pi}i>o are such that ()<Pi<1 and Lio Pi = 1. Do the following: (a) Construct the matrix representation of the Markov chain. Just like your diagram (b) Show that for all y → 0.0 →y. How are the trajectories of this chain? What states are communicated? (c) Calculate Po [To = n] for n > 1 (d) Is the string recursive?