Find recurrent and transient classes and periods of states

Assignment Help Mathematics
Reference no: EM131127728

A country has m+1 cities (m ∈ N), one of which is the capital. There is a direct railway connection between each city and the capital, but there are no tracks between any two "non-capital" cities. A traveler starts in the capital and takes a train to a randomly chosen noncapital city (all cities are equally likely to be chosen), spends a night there and returns the next morning and immediately boards the train to the next city according to the same rule, spends the night there, . . . , etc. We assume that his choice of the city is independent of the cities visited in the past. Let {Xn}nN0 be the number of visited non-capital cities up to (and including) day n, so that X= 1, but Xcould be either 1 or 2, etc.

Explain why {Xn}nN0 is a Markov chain on the appropriate state space S and the find the transition probabilities of {Xn}nN0, i.e., write an expression for

P[Xn+1 = j|X= i], for i,j ∈ S.

Find recurrent and transient classes and periods of all states. Sketch the transition graphfor m = 3.

Let τbe the first time the traveler has visited all m non-capital cities, i.e.

τ= min{n ∈ N0 : X= m}.

What is the distribution of τm, for m = 1 and m = 2.

Compute E[τm] for general m ∈ N. (Note: you don't need to use any heavy machinery. In particular, no knowledge of the "absorption and reward" techniques are necessary.)

Reference no: EM131127728

Questions Cloud

What is the expected price of the stock next year : Gordon & Co.'s stock has just paid its annual dividend of $1.10 per share. Analysts believe that Gordon will maintain its historic dividend growth rate of 3%. If the required return is 8%, what is the expected price of the stock next year?
Production manager of manufacturing facility : You are the production manager of a manufacturing facility. There will be a meeting with the Staff to discuss a potential back order that will occur if 10 batches are not produced between now and April 25, 2016. Based on what you learned on setting a..
The key to the cordless elevator : Building elevators are limited to about 800 meters. Above that height, elevator cables become too thick and too heavy for practical use. One solution is to eliminate the cable.
Calculate the peak current and the apparent power : Calculate the peak current and the apparent power supplied to the load.
Find recurrent and transient classes and periods of states : Find recurrent and transient classes and periods of all states - Explain why {Xn}n∈N0 is a Markov chain on the appropriate state space S and the find the transition probabilities
What is the required return on microsoft : Suppose Microsoft, Inc. is trading at $27.29 per share. It pays an annual dividend of $0.32 per share, which is double last year’s dividend of $0.16 per share. If this trend is expected to continue, what is the required return on Microsoft?
Cause the system step response : A control system is shown in Figure AP9.8. The gain K is greater than 500 and less than 3000. Select a gain that will cause the system step response to have an overshoot of less than 20%. Plot the Nichols diagram, and calculate the phase margin.
Misfire company is a small editorial services company : On August 31, 2010, the end of the current year, Misfire Company's accounting clerk prepared the unadjusted trial balance shown on the next page.
What is the current price per share : Huskie Motors just paid an annual dividend of $1.00 per share. Management has promised shareholders to increase dividends at a constant rate of 5%. If the required return is 12%, what is the current price per share?

Reviews

Write a Review

Mathematics Questions & Answers

  Flank wear data were collected in a series of turning tests

Flank wear data were collected in a series of turning tests using a coated carbide tool on hardened alloy steel at a feed of 0.30 mm/rev and a depth of 4.0 mm. At a speed of 100 m/min, flank wear = 0.12 mm at 1 min, 0.27 mm at 5 min, 0.45 mm at 11 mi..

  Question under ideal conditions a certain bacteria

question under ideal conditions a certain bacteria population is known to double every three hours. suppose that there

  Formulate a linear programming model for this problem

Each new lawyer the firm hires is expected to handle 150 hours per month of casework and to work all year. All casework must be completed by the end of the year. the firm wants to know how many new lawyers it should hire for the year.

  Information about equation of circle

Find the equation of the circle that has its center at the focus of the parabola X^2 - 4x + 6y - 20 = 0 and that is tangent to the parabola at its vertex. Also sketch both curves.

  Describe how the notion of union and intersection apply

Discuss the notion of the logical "or" and the logical "and" in computer programming (coding) or flowcharts. Why is it important to know how to apply these correctly?

  Complex number in polar form

1. Plot the complex number.z= 4 + 5i 2. Find the absolute value of the complex number.z= 14i 3. Write the complex number in polar form. Express the argument in degrees.z= 5i

  Suppose that angles measure 2x and 4x6 are supplementary

suppose that angles measure 2x and 4x6 are supplementary. what are the measures of the angles? in

  Prove the statement is true for all positive integers

Use mathematical induction to prove the statement is true for all positive integers, or show why it is false. 4·6 + 5·7 + 6·8 + ... + 4n(4n+2) = 4(4n+1)(8n+7)/6

  Calculate the amount insurance company paid out in benefits

driver alan has a poor driving record and pays triple the regular premium would be 2100 and covers alan for all three

  How many seconds will the stone hit the ground

After how many seconds will the stone hit the ground? Round to the nearest hundredth's place; include units in your answer.

  What area can it cover

what area can it cover?

  Probability of picking groups of cards

Probability of Picking Groups of Cards, Find the probability that a hand of 13 cards dealt from a well shuffled pack of 52 contains

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd