Explain markov chain and steady state probabilities

Assignment Help Mathematics
Reference no: EM13117870

Markov Chain and Steady State Probabilities

1. A production process contains a machine that deteriorates rapidly in both quantity and output under heavy usage, so it is inspected at the end of each day. Immediately after inspection the condition of the machine is noted and classified into one of four possible states:

State
0: good as new
1: Operable - minimum deterioration
2: Operable - major deterioration
3: Inoperable and replaced by a good new machine

The process can be modeled as a Markov Chain with the following transition matrix:

State...............0................1................2...............3
0.....................0................7/8............1/16..........1/16
1.....................0................3/4.............1/8...........1/8
2.....................0.................0...............1/2............1/2
3.....................1.................0................0...............0

a) find the steady state probabilities of being in each state

b) if the daily costs of being in states 0, 1, 2, 3 are $0, $1000, $3000, $6000 respectively, what is the expected long run daily cost?

c) reclassify state 3 as an absorbing state and calculate the expected number of days for a 'good as new' machine to become inoperable.

Reference no: EM13117870

Questions Cloud

How much carbon-14 would remain after 4 half-lives : The half-life of carbon-14 is 5,730 years. If you started with 100.0 g of carbon-14, how much carbon-14 would remain after 4 half-lives.
Determining a person''s blood type prior to receiving : How is it that, unlike polysaccharides such as starch and glycogen, the oligosaccharides on the surface of the plasma membrane can be involved in specific interaction? How is this feature illustrated by determining a person's blood type prior to r..
Probability that at least one televisions does not work : if tow televisions are randomly selected, compute the probability that both televisions work. what is the probability that at least one does not work?
Evaluate the magnitude of the torque about his shoulder : His arm is 70 cm long and has a mass of 4.0 kg. Evaluate the magnitude of the torque about his shoulder if he holds his arm straight out to his side, parallel to the floor?
Explain markov chain and steady state probabilities : A production process contains a machine that deteriorates rapidly in both quantity and output under heavy usage, so it is inspected at the end of each day. Immediately after inspection the condition of the machine is noted and classified into one ..
Use liposomes in an attempt to deliver drugs : Suppose you were planning to use liposomes in an attempt to deliver drugs to a particular type of cell in the body, for example, a fat or muscle cell. Is there any way you might be able to construct the liposome to increase its target specificity?
Galois theory-cubic polynomial : Show how to make a change of variables x' = x - lamda in f (x) = 0 to reduce to a monic equation where the coefficient of x^2 is zero
Comparative outline for the short stories : Write a comparative outline for the short stories "The Lottery" and "A Worn Path."
What is the equilibrium molar concentration of hydrogen : A mixture of 0.1079 M CO (g) and 0.1079 M H2O(g) was allowed to react and come to equilibrium at some temperature. If Kc = 5.668, what is the equilibrium molar concentration of H2 for the reaction.

Reviews

Write a Review

Mathematics Questions & Answers

  Questions on ferris wheel

Prepare a Flexible Budget Gator Divers is a company that provides diving services such as underwater ship repairs to clients in the Tampa Bay area.

  Logistic map

This assignment has two question related to maths. Questions are related to bifurcation cascade and logistic map.

  Finding the probability of cards

This assignment has questions related to probabiltiy.

  Systems of ode

Find all the xed points, and study their stability and Draw the phase portrait of the system, as well as the graphs of the solutions in all relevant cases.

  Derive the boolean expression

Derive the Boolean Expression and construct the switching circuit for the truth table stated

  System of equations

Evaluate which equations are under-identified, just-identified, and over-identified.

  Linear programming problem

Linear programming problem consisting of only two constraints with one objective function.

  Find the natural domain

Find the natural domain of the given functions.

  Introduction to numerical methods

Compute the coecients of the polynomials using the term recurrence relation.

  Chart of the topological manifold

De?nition of smoothness of functions on a smooth manifold is chart independent and hence geometric.

  Mathematics in computing

Questions related on mathematics in computing.

  Complex problems

Complex problems

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd