lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

North west corner rule, North West Corner Rule for Initial Solution: Now ...

North West Corner Rule for Initial Solution: Now by applying North West corner rule we can initial solution. According to this rule without regard to cost consideration the

WEITING MODEL(QUEUING), CONSIDER A BARBER SHOP WITH ONE CHAIR, ONE BARBER A...

CONSIDER A BARBER SHOP WITH ONE CHAIR, ONE BARBER AND NO ROOM FOR CUSTOMER TO WAIT. IF THE CHAIR IS EMPTY WHEN THE CUSTOMER ARRIVES,HE ENTER THE SHOP AND HIS HAIR CUT BEGINS. IF TH

Simplex method of LP, MAX: 150 X1 + 250 X2 Subject to: 2 X1 + 5 X2 = 200 - ...

MAX: 150 X1 + 250 X2 Subject to: 2 X1 + 5 X2 = 200 - resource 1 3 X1 + 7 X2 = 175 - resource 2 X1, X2 = 0 2. How many units of resource 1 are cons

Formulation of relevant hypotheses and models, Tentative explanations when ...

Tentative explanations when formulated as propositions are called hypotheses. It is very important to state the hypothesis and its anticipated consequences before star

Linear programming, Ask question #Minimum 100 words acceptNas food produces...

Ask question #Minimum 100 words acceptNas food produces to kinds of popular dark chocolate bars. the banana and coffee. the banana bar costs 0.22 to make and sells of 0.35, where a

Linear programming , A paper mill produces two grades of paper viz., X and ...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Overhead projector -report writing presentation , Overhead Projector  ...

Overhead Projector  Overhead  projector  casts an images of the transparencies  on a  screen. Transparencies  are frequently  used  visual  aids  especially  when  audience

Research paper, Research Paper Overview Research Topic: •    Research ...

Research Paper Overview Research Topic: •    Research the effects of federal mandates in your state.  Examples include the Americans with Disabilities Act, the No Child Left B

Importance of normal distribution , Importance of Normal Distribution ...

Importance of Normal Distribution Normal distribution  plays  a very  important  role in  statistical  theory  and in  particular  in sampling theory. It has  been  found  th

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd