Define a markov chain, Define a Markov chain with r+1

Define a markov chain

Assignment Help Mathematics

Reference no: EM13179208

An individual has r umbrellas which he uses in going from his home to his office and vice versa. If he is at home (at the office) at the beginning (end) of the day and it is raining, then he will take an umbrella with him to the office (home), provided there is one to be taken. If it not raining then he never takes an umbrella. Assume that, independent of the past, it rains at the beginning (end) of a day with probability p. Let Xn denotes the number of umbrellas the individual has at his disposal at the moment he begins his nth trip.

i) Define a Markov chain with r+1 classes and find its transition probability matrix.
ii) Find the limiting probabilities.
iii) What fraction of time does the individual get wet?

Reference no: EM13179208

Questions Cloud

How fast is the object moving 9s after being thrown : How fast is the object moving 9s after being thrown?

Standard costs and plans for fiscal current year : Spam Inc. had the following standard costs and plans for fiscal current year for the production' of custom meat products Plan 500,000 Plan Direct Material

Find the interest and the amount repaid : find the interest and the amount repaid using a 360-day year. round to the nearest cent. $9400.00principal, 10%rate, 36 days time. need to find the interest and amount.

Define the factors that influence the elasticity of demand : If the quantity demanded for apples increases by 1.25 per cent when the price of grapes increases by 2.5 per cent, the cross elasticity of demand between apple and grapes is,Suppose a rise in the price of a good from $7.50 to $8.50 leads to a decr..

Define a markov chain : Define a Markov chain with r+1 classes and find its transition probability matrix.

What is the probability that a freshman selected at random : What is the probability that a freshman selected at random from this group is enrolled in each of the following? (Enter your answers to three decimal places.)

Prepare a revised aging schedule showing ages of accounts : Prepare a revised aging schedule showing ages of the accounts receivable after the write-offs. Be very careful with your dates. [Hint: Be sure to reflect the write-offs taken in E above, in the correct age category].

Real property and tangible personal property : What is the difference between real property and tangible personal property? Differentiate between an ownership and a possessory interest in real estate.

Find the dimensions of the strongest beam : The strength of a rectangular beam is proportional to the product of its width and the square of its depth. Find the dimensions of the strongest beam that can be cut from a circular cylindrical log of radius r.

User Account

All Pages