lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Experimental method, In this method variables beings studied are contro...

In this method variables beings studied are controlled by the investigator. In other the effect of one variable is observed while other relevant variables are held constant

Linear programming, b. A paper mill produces two grades of paper viz., X an...

b. A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y pape

Linear proramming , A paper mill produces two grades of paper viz., X and Y...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Sample survey methods:, Sample Survey Methods: If proposed investigati...

Sample Survey Methods: If proposed investigation is done  only on  a part taken  out of  universe then it  will be  known  as sample  survey. This  part of the universe is kno

Inherent forces fomenting conflicts of interest, Inherent forces fomenting ...

Inherent forces fomenting conflicts of interest Several forces have coalesced to increase the incidence of conflicts of interest in the medical industry: the vertical integrat

the simplex method, In large sized linear programming problems, the ...

In large sized linear programming problems, the solution cannot be obtained by the graphical method and hence a more systematic method has to be developed to find

Z-test - hypothesis testing, Z-Test Prof. Fisher has  given a method  of...

Z-Test Prof. Fisher has  given a method  of testing the significance of the correlation coefficient in small  samples. According  to this method the  coefficient of correlation

Lcd projectors - reoprt writing presentation , LCD Projectors  LCD...

LCD Projectors  LCD projectors  are several  steps  ahead of conventional OHPs. These  projectors  are more  compact  and more  powerful  and can  be directly  linked to a

Information concept and characteristics, INFORMATION AND OTHER RELATED CONC...

INFORMATION AND OTHER RELATED CONCEPTS - THEIR MEANING AND CHARACTERISTICS: You may often hear or read in newspapers and other popular magazines about "exponential growth of i

Linear Programming Problem using Simple method, Solve the following Linear ...

Solve the following Linear Programming Problem using Simple method. Maximize Z= 3x1 + 2X2 Subject to the constraints: X1+ X2 = 4 X1 - X2 = 2 X1, X2 = 0

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd