What is expected time that will pass before the chain first

Assignment Help Mathematics
Reference no: EM131127734

Let {Xn}nN0 be a Markov chain with the following transition matrix

Suppose that the chains starts from the state 1.      

What is expected time that will pass before the chain first hits 3?

What is the expected number of visits to state 2 before 3 is hit?

Would your answers to (1) and (2) change if we replaced values in the first row of P by any other values (as long as P remains a stochastic matrix)? Would 1 and 2 still be transient states?

Use the idea of part (3) to answer the following question.

What is the expected number of visits to the state 2 before a Markov chain with transition matrix hits the state 3 for the first time (the initial state is still 1)?

Reference no: EM131127734

Questions Cloud

What is the probability that the first time he gets wet : What is the expected number of days that will pass before the professor gets wet (remember, there are two trips each day)? What is the probability that the first time he gets wet it is on his way home from the office?
The control of a paper-making machine : The control of a paper-making machine is quite complex [27].The goal is to deposit the proper amount of fiber suspension (pulp) at the right speed and in a uniform way.
Determine the correct amount of net income for april : Journalize the entries to record the omitted adjustments.
Planning many mars missions with rover vehicles : NASA is planning many Mars missions with rover vehicles. A typical rover is a solar-powered vehicle which will see where it is going with TV cameras and will measure distance to objects with laser range finders.
What is expected time that will pass before the chain first : What is expected time that will pass before the chain first hits 3 - what is the expected number of visits to state 2 before 3 is hit?
The acidity of water draining from a coal : The acidity of water draining from a coal mine is often controlled by adding lime to the water. A valve controls the lime addition and a sensor is downstream. For the model of the system shown in Figure AP9.6, determine K and the distance D to mai..
What is the expected price of the stock next year : Gordon & Co.'s stock has just paid its annual dividend of $1.10 per share. Analysts believe that Gordon will maintain its historic dividend growth rate of 3%. If the required return is 8%, what is the expected price of the stock next year?
Production manager of manufacturing facility : You are the production manager of a manufacturing facility. There will be a meeting with the Staff to discuss a potential back order that will occur if 10 batches are not produced between now and April 25, 2016. Based on what you learned on setting a..
The key to the cordless elevator : Building elevators are limited to about 800 meters. Above that height, elevator cables become too thick and too heavy for practical use. One solution is to eliminate the cable.

Reviews

Write a Review

Mathematics Questions & Answers

  Determining maximum volume and tangents

A box with its base in the xy-plane has its four upper vertices on the surface with equation z=48-3x^2-4y^2. What is the maximum possible volume.

  Determine the ways to make up a full load

A plane has capacity 15, 921 pounds. A company wants to ship two types of motorcycles, one 957 pounds and one 609 pounds. Determine the ways to make up a full load with these two types of motorcycles

  Find the commission rates for each product

Casey earned $5200 last month for selling 12 units of product x and 8 units of product y. Find the commission rates for each product.

  Calculate the value of interference for this interval

Calculate the value of interference for this interval.

  Application of differential calculus in economics profit

application of differential calculus in economics profit cost and revenue function.the total cost cq of production

  What is the probability that all graduate

In a report on high school graduation, it was stated that 85% of high school student graduate. Suppose 3 high school students are randomly selected from different schools. What is the probability that all graduate?

  Complete the following in a word document

In order to control costs, a company wishes to study the amount of money its sales force spends entertaining clients. The following is a random sample of six entertainment expenses (dinner costs for four people) from expenses reports submitted by ..

  Characteristics of a mapping

Let M be a two by two matrix for which each element is a real number, and let S be the set of all such matrices. Consider the mapping f of S to the real numbers R defined by the relation f(M) = determinant of M.

  Explain all null and alternative hypotheses we require

suppose we are trying to find the effects of 3 categorical variables on the response numerical variable. factor a with

  Identify a handful of leading metrics

In a well-organized and detailed essay, identify a handful of leading metrics that you think an organization can use or could implement to help with the continuous improvement efforts of the company's management systems. Reflect on the key risks f..

  Conduct the appropriate analysis

A college student is interested whether there is a difference between male and female students in the amount of time spending working out each week. The student gathers information from a random sample of male and female students on her campus.

  29 offered liberal arts degree computer engineering degree

242 offered a liberal arts degree. 116 offered a computer engineering degree. 467 offered a nursing degree. 35 offered

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd