Explain markov chain and steady state probabilities

Assignment Help Mathematics
Reference no: EM13117870

Markov Chain and Steady State Probabilities

1. A production process contains a machine that deteriorates rapidly in both quantity and output under heavy usage, so it is inspected at the end of each day. Immediately after inspection the condition of the machine is noted and classified into one of four possible states:

State
0: good as new
1: Operable - minimum deterioration
2: Operable - major deterioration
3: Inoperable and replaced by a good new machine

The process can be modeled as a Markov Chain with the following transition matrix:

State...............0................1................2...............3
0.....................0................7/8............1/16..........1/16
1.....................0................3/4.............1/8...........1/8
2.....................0.................0...............1/2............1/2
3.....................1.................0................0...............0

a) find the steady state probabilities of being in each state

b) if the daily costs of being in states 0, 1, 2, 3 are $0, $1000, $3000, $6000 respectively, what is the expected long run daily cost?

c) reclassify state 3 as an absorbing state and calculate the expected number of days for a 'good as new' machine to become inoperable.

Reference no: EM13117870

Questions Cloud

How much carbon-14 would remain after 4 half-lives : The half-life of carbon-14 is 5,730 years. If you started with 100.0 g of carbon-14, how much carbon-14 would remain after 4 half-lives.
Determining a person''s blood type prior to receiving : How is it that, unlike polysaccharides such as starch and glycogen, the oligosaccharides on the surface of the plasma membrane can be involved in specific interaction? How is this feature illustrated by determining a person's blood type prior to r..
Probability that at least one televisions does not work : if tow televisions are randomly selected, compute the probability that both televisions work. what is the probability that at least one does not work?
Evaluate the magnitude of the torque about his shoulder : His arm is 70 cm long and has a mass of 4.0 kg. Evaluate the magnitude of the torque about his shoulder if he holds his arm straight out to his side, parallel to the floor?
Explain markov chain and steady state probabilities : A production process contains a machine that deteriorates rapidly in both quantity and output under heavy usage, so it is inspected at the end of each day. Immediately after inspection the condition of the machine is noted and classified into one ..
Use liposomes in an attempt to deliver drugs : Suppose you were planning to use liposomes in an attempt to deliver drugs to a particular type of cell in the body, for example, a fat or muscle cell. Is there any way you might be able to construct the liposome to increase its target specificity?
Galois theory-cubic polynomial : Show how to make a change of variables x' = x - lamda in f (x) = 0 to reduce to a monic equation where the coefficient of x^2 is zero
Comparative outline for the short stories : Write a comparative outline for the short stories "The Lottery" and "A Worn Path."
What is the equilibrium molar concentration of hydrogen : A mixture of 0.1079 M CO (g) and 0.1079 M H2O(g) was allowed to react and come to equilibrium at some temperature. If Kc = 5.668, what is the equilibrium molar concentration of H2 for the reaction.

Reviews

Write a Review

Mathematics Questions & Answers

  Find the probability on poisson distribution

Find the probability on poisson distribution.

  The tangent line equation

The tangent line equation

  Chi square test

Chi square test

  Population growth rate

Population growth rate

  Applications of the law of cosines

Applications of the law of Cosines - Evaluate the side of a regular dodecagon that is inscribed in a circle with radius 4 cm.

  Find an 85 percent confidence interval

Find an 85 percent confidence interval

  Find the maximum and minimum concavitiy

Find the maximum and minimum concavitiy

  Find the probability that the strike vote is rejected

A union strike vote is scheduled for tomorrow, and it looks close. You expect 100 people to vote, and the probability that a typical individual will vote to strike is estimated to be 0.4. Suppose that the voters make their decisions independent from ..

  Find the five month moving average

Find the five month moving average

  Calculate the missing r-square statistic

Calculate the missing R-square statistic.

  A significant difference in the average amount

A significant difference in the average amount

  A least squares regression line

A least squares regression line.

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd