Given a Markov process with state space 1, 2, 3 and transition probabilities p(2 | 1) = 7/10, p(3 | 1) = 2/10, p(1 | 2)
Posted: Mon Sep 06, 2021 7:12 am
Given a Markov process with state space 1, 2, 3 and transition
probabilities p(2 | 1) = 7/10, p(3 | 1) = 2/10, p(1 | 2) = 4/10,
p(3 | 2) = 1/10, p(1 | 3) = 3/10, p(2 | 3) = 1/10, compute the
remaining entries in the transition matrix and write out the
matrix. Draw a diagram of the chain. Obtain the steady state
distribution of this Markov chain. Justify your work fully.
probabilities p(2 | 1) = 7/10, p(3 | 1) = 2/10, p(1 | 2) = 4/10,
p(3 | 2) = 1/10, p(1 | 3) = 3/10, p(2 | 3) = 1/10, compute the
remaining entries in the transition matrix and write out the
matrix. Draw a diagram of the chain. Obtain the steady state
distribution of this Markov chain. Justify your work fully.