- Markov Process Bob Is From Liverpool He Is Torn Between The Blues And The Reds But Secretly He Also Likes Rubgy Ev 1 (257.82 KiB) Viewed 99 times
posted in accordance to answers guidelines so answer all sub
questions.
Markov process Bob is from Liverpool, he is torn between the blues and the reds but - secretly - he also likes rubgy. Every weekend Bob has to decide if he is going to watch Liverpool FC (L), Everton FC (E), or St Helens (H). The decision process follows a Markov chain: • If, on a given weekend Bob, watches Everton then on the following weekend the probability that he will watch Liverpool is 50%, and the probability that he will watch St Helens is 33%. • If he is watching Liverpool, then the probability that he will watch Liverpool the following weekend is 55% and 15% for Everton. • If he is watching St Helens, then he will watch St Helens again the following week with a probability of 60% and Liverpool with probability 10%. Questions: i) Either numerically or analytically, find out what the stable state of system and deduce the probabilities of watching Everton, Liverpool or St Helens on average. marks) ii) How do the average probabilities depend on the initial state ? (3 marks) iii) Find out where Bob comes from and justify. (3 marks) Note: The problem can be solved numerically using a computer code, in which case you are asked to submit a copy of your code in an attachment. If you prefer to solve it “by hand”, you are require to include the details of your computation.