Let X1,X2,… be a sequence of independent and identically distributed random variables with Bernoulli probability funct
Posted: Wed Jul 13, 2022 5:07 am
Let X1,X2,… be a sequence of independent and identically distributed random variables with Bernoulli probability function given by fX(x)={px(1−p)1−x,0,x=0,1 otherwise Let Yn=min(3,i=1∑nXi),n=1,2,…, where i=1∑nXi is the total number of ones in the first n trials, Y0=0. a. Explain why the sequence Y0,Y1,Y2,… is a Markov chain. b. Determine the states of the Markov chain. c. Find the transition matrix P. d. Does the Markov chain have any absorbing states? Justify your answer.