Draw the state transition diagram

Reference no: EM133128089

Question: Romeo and Juliet wants to meet in secret, but they cannot see each other and cannot tell where to meet. There are two places they can meet. Every day, each one randomly and independently picks one of those two locations and goes to that location hoping to meet the other. Picks are also random and independent from the other days. Romeo starts at location 1 and picks a location according to the following transition matrix:

Unfortunately, Juliet starts with location 2 and picks a location according to the following transition probability matrix:

The problem ends when they meet (i.e., if and when they meet, they can arrange their next meeting (hmmm... maybe not)). We would like to formulate an MC that will help us determine the probability that they will meet, when they meet etc.

(a) Write the state definition and derive the transition probability matrix for the corresponding MC. Note: Do not subtract sum of other elements of a row to find the remaining probability, derive all probabilities one by one in the transition matrix.

(b) Draw the state transition diagram.

Reference no: EM133128089

Questions Cloud

Draw a diagram or write an equation manually : "Assume that 10% increase in the price of good A leads to 15% reduction in the sale of good B. This implies good A and good B must be complementary goods"

What is the internal rate of return of this sale : You save that costume for ~12 years when, on May the 4th (5/4/34) a Star Wars fanatic buys it off of you for $299.00. What is the internal rate of return

Holding the overall costs of production constant : Consider the following scenario: the firm estimates that currently, its marginal product of labor is 80, while the marginal product of capital is 160. The firm

What is the firm average total cost : A firm has the following short-run cost schedule:

Draw the state transition diagram : Write the state definition and derive the transition probability matrix for the corresponding MC. Note: Do not subtract sum of other elements

Explain the proposed full employment policy : 3. Finally make a summary as to whether or not you would support this proposed "full employment" policy.

How tour of sp premises will assist the auditor in planning : Your audit firm, Kellie & Associates, has just been appointed the auditor of a large manufacturing company, How tour of SP premises will assist the auditor

Confidence interval for the order completion time : How long does a customer have to wait until their order is complete? A random sample of 100 orders showed a sample mean 34.2 minutes with a standard deviation 9

Interval for the proportio of obese in the us : What percentage of the U.S. population is obese? A random sample of 1000 U.S. residents showed 463 obese. Obtain the 95% confidence interval for the proportio o

User Account

All Pages